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ABSTRACT 

We investigate the implications of the intergalactic opacity for the evolution of the cosmic ultraviolet 
luminosity density and its sources. Our main constraint follows from our measurement of the Lyman-a 
forest opacity at redshifts 2 < z < 4.2 from a sample of 86 high-resolution quasar spectra. In addition, 
we impose the requirements that intergalactic HI must be reionized by z — 6 and Hell by z « 3, and 
consider estimates of the hardness of the ionizing background from HI to Hell column density ratio 
measurements. The derived hydrogen photoionization rate is remarkably flat over the Lya forest 
redshift range covered. Because the quasar luminosity function is strongly peaked near z ~ 2, the 
lack of redshift evolution indicates that star-forming galaxies likely dominate the photoionization rate 
at z > 3, and possibly at all redshifts probed. Combined with direct measurements of the galaxy UV 
luminosity function, this requires only a small (emissivity weighted) fraction / csc ~ 0.5% of galactic 
hydrogen ionizing photons to escape their source for galaxies to solely account for the entire ionizing 
background. Under the assumption that the galactic UV emissivity traces the star formation rate 
(which is the case if the escape fraction and dust obscuration are constant with redshift), current 
state-of-the-art observational estimates of the star formation rate density, which peak similarly to 
quasars at z ~ 2, appear to underestimate the total photoionization rate at z w 4 by a factor sa 4, 
arc in tension with the most recent determinations of the UV luminosity function, and fail to reionize 
the Universe by z = 6 if extrapolated to arbitrarily high redshift. A star formation history peaking 
earlier, as in the theoretical model of Hernquist & Springel, fits the Lya forest photoionization rate 
well, reionizes the Universe in time, and is in better agreement with the rate of z w 4 gamma-ray 
bursts observed by Swift. Quasars suffice to doubly ionize helium by z ss 3, provided that most of 
the Hell ionizing photons they produce escape into the intergalactic medium, and likely contribute 
a non-negligible and perhaps dominant fraction of the hydrogen ionizing background at their z ~ 2 
peak. 

Subject headings: Cosmology: theory, diffuse radiation — methods: data analysis — galaxies: forma- 
tion, evolution — quasars: general, absorption lines 
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1. INTRODUCTION 

The opacity of the Lyman-a (Lya) forest is set 
by a competition b etween hydrogen photoi onizations 
and recombinations ()Gunn &; PetersonMl965h and can 
thus serve as a p robe of the photonization rate (e.g. 
iRauch et al.l IL997T ). The hydrogen photoionization rate 
r is a particularly valuable quantity as it is an integral 
over all sources of ultraviolet (UV) radiation in the Uni- 
verse, 

T(z) = 4tt / —J v { z )a(v), (1) 

where J„ is the angle-averaged specific intensity of 
the background, o~{y) is the photoionization cross sec- 
tion of hydrogen, and the integral is from the Ly- 
man limit to infinity. As such, it bears a signa- 
ture of cosmic stellar and quasistellar activity that is 
not subject to the c ompleteness issues to which direct 
source counts (e.g. , Stcidcl ct al. 1999; Bouwens et all 
2004t ISawicki fc Thompsonl 120061: Bouwens et all 120071 : 
Yoshida et al.1 120061 : iHopkins et a l. 2007) are prone. In 



addition, unlike the radiation backgrounds directly ob- 
served on Earth, the Lya forest is a local probe of the 
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high-redshift UV background, as only sources at approx- 
imately th e same redshift contribu te to T at any point in 
the forest (|Haardt k. Madaulll996l ). 

The hydrogen photoionization rate is not only a pow- 
erful observational tracer of cosmic radiative history, but 
is also a key ingredient in cosmological simulations and 
theoretical models of galaxy formation. Photoioniza- 
tion heating can, for example, suppress the formation 
of dwarf galaxies (Efstathiou 1992; Thoul & Weinberg 
119961 : IWeinberg et all ll997aL While the photoioniza- 
tion rate of hydrogen by itself provides limited infor- 
mation on the shape of the background spectrum, it 
can be combined with the photoionization rates of other 
species (helium, for example) to prov ide a direct mea- 
sure of the bac kground hardness (e.g..lCroft et al.lll997l : 
ISokasianet"aLl l2003afc iBolton et al.ll2006h . The back- 



ground spectrum sets the temperature of the gas and 
so it must be specified in any hydrodynamical simula- 
tion of structure formation (e.g., iHernquist et al. 1996; 
iDave et al.l 119991: ISpringel fc Hernquistj|2003bt ). Knowl- 
edge of the ionizing background spectrum is also neces- 
sary to infer the mass density of metals from observa- 
tions of absorpt ion by particular ions ("ionization cor- 
rectio ns") (e.g.. ISchave et all 120031 : lAguirre etldl I2004L 
12001 . 

Recent results make it especially worthwhile to recon- 
sider the implications for the ionizing sources, usually as- 
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sumed to be a combination of q uasars and star-forming 
galaxies (e.g. JMadau et al] fl999). of the Lya forest opac- 
ity in the light of new data. The comoving star formation 
rate (SFR) density as estimated from the observed lumi- 
nosity of galaxies, for instance, is in tension with the in- 
depe ndently derived evolution o f the stellar mass density 
(e.g.. lHopkins fc Beacomll2006l) . This suggests problems 
with observational estimates of the cosmic SFR, to which 
T is sensitive. The abundance of intergalactic metals as 
traced by CIV appears con sistent with being constant 
from z ~ 2 to perhaps z ~ 6 (Songaila 2001; P ettini et al.l 
120031 : iRvan- Weber et alJl2006f ) . suggestive of an early pe- 
riod of nucleosynthetic activity that may be at odds with 
estimates of the SFR density that decline above z ~ 2 — 3 
(|Hopkinsl[200l iHopkins fe B eacoml l2006D. Stellar mass 
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density m e asurements at z > 5 (e.g ., _ 
lYan et all [20061 : lEvles et all 120071 : IStark et alJ 12007a 
also suggest significant early star formation. In addition, 
deep z ~ 6 — 10 searche s utilizing magnifica t ion by fore- 
ground galaxy clusters (jRichard et alJl2006t I Stark etall 
2007b) have yielded surprisingly large abundances of low- 
luminosity galaxies, in tension with blank field surveys 
and perhaps even requiring an upturn in the ir abundance 
with i ncreasing redshift. At lower redshifts. lRauch et al.l 
(2007) discovered a large population of faint Lya emitters 
at 2.67 < z < 3.75 in an extremely deep 92-hour exposure 
with VLT/FORS2, most of which would not have been 
selected in existing Lyman-break surveys. This under- 
scores the definite possibility that photometric-selection 
surveys may presently miss a substantial fraction of the 
cosmic luminosity density originating in low-luminosity 
objects. 

Here, we use improved measurements of the intergalac- 
tic opacity at z > 2 to obtain a measurement of the 
hydrogen photoionization rate T. We present a detailed 
comparison with direct source counts of quasars and star- 
forming galaxies and ask whether these can account for 
the measured I\ Finally, we consider the implications for 
the estimates of the cosmic SFR density and the escape 
fraction of ionizing photons from galaxies, which relates 
the soft UV emission to the photons that actually con- 
tribute to photoionizations. 

The observational constraints we use are described in 
$2] In Sj3[ we derive the hydrogen photoionization rate 
implied by our recent measurement o f the Lya forest 
opacity (|Faucher-Giguere et al.l [2008ch and explore po- 
tential systematic effects. In fJU we describe how to con- 
vert the photoionization rate to a UV luminosity density. 
We investigate the implications for the cosmic sources of 
UV radiation, quasars and star-forming galaxies in Sj5[ 
We also consider the constraints imposed by the reion- 
izations of hydrogen and helium in this section. We re- 
visit the star formation history in §6\ before discussing 
our results in Sj7] and summarizing our conclusions $8] 

Throughout, we assume a cosmology with 
(fi m , fi b , fiA, h, er 8 ) = (0.28, 0.046, 0.72, 0.70, 0.82), 
as inferred from the Wilkinson Microwave Anisotropy 
Probe (WMAP) five-year data in combination 
with baryon acoust ic oscillations and supernovae 
(|Komatsu et al.l I2008D . Unless otherwise stated, all 
error bars are la. Some of the results presented here 
were already reported in a c oncise companion Letter 
(|Faucher-Giguere et all l2008af) . They are described 
here with the full details of the analysis and underlying 
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LYa Effective Optical Depth and Derived 

Hydrogen Photoionization Rate 
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0.010 


0.51 
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0.012 


0.51 


0.06 


3.0 


0.386 


0.014 


0.59 


0.07 


3.2 


0.415 


0.017 


0.66 


0.08 


3.4 


0.570 


0.019 


0.53 


0.05 


3.6 


0.716 


0.030 


0.49 


0.05 


3.8 


0.832 


0.025 


0.51 


0.04 


4.0 


0.934 


0.037 


0.55 


0.05 


4.2 


1.061 


0.091 


0.52 


0.08 



a Mea surement reported by iFauchcr-Gigucr c et al.l 
( 2008c) corrected for continuum bias binned in Az = 
0.2 intervals and with the contribution of metals to 
absorption in the Lya forest subtracted based on the 
results of lSchave et alJ j2003t ). b Statistical only. c De- 
rived as in ij3] d Includes contributions from the sta- 
tistical uncertainties in both r e g and To. 

assumptions, as well as supporting arguments. 

2. OBSERVATIONAL CONSTRAINTS 

The main observational constraint we use is our mea- 
surement of the Lya for est effective optical depth be - 
tween z = 2 and z — 4.2 (|Faucher-Giguere et al.| [2008c). 
This measurement, based on 86 quasar spectra obtained 
with the HIRES and ESI spectrographs on Keck and 
with MIKE on Magellan, is the most precise to date from 
high-resolution, high-signal-to-noise data in this redshift 
interval. We use our measurement corrected for contin- 
uum bias binned in Az = 0.2 intervals with the contri- 
bution of metals to ab sorption in the fores t subtracted 
following the results of lSchave et al.l (|2003ft . For conve- 
nience, these data points are reproduced in Table Q] In 
iFaucher-Giguere et al.l (|2008cD . we provided estimates of 
the systematic uncertainty in r e ff arising from the con- 
tinuum and metal corrections. In this paper, we are 
however most concerned with the derived photoioniza- 
tion rate. As the systematic uncertainties in converting 
r e ff to r (involving the thermal history of the IGM) are 
larger than those from the continuum and metal correc- 
tions, we simply use the statistical error bars on T e g and 
separately explore the systematic effects influencing our 
inference of T in this work. 

We further employ the constraints set by the reioniza- 
tions of hydrogen and helium. Specifically, we use the 
fact that hydrogen is reionize d by z = 6, as in d icated 
by the absence of a complete iGunn fc Peterson] (|1965l ) 
troug h in the spect ra of quasars at this redshift (see, 
e.g. I Fan et all 2006, for a review of the present obser- 
vational constraints on reionization) . We assume that 
helium is doubly ionized by 2 « 3, as supported by 
UV spectra of the Hell L ya forest of z ~ 3 quasars. 
f Jako bsen et alJ 1199 4: Rcim ers et al.l 119971: iHogan et al. 
1997tlHeap et al.ll2000l:ISmette et al.ll2002tlReimers et al. 
IF 
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Finally, we use estimates of the spectrum of th e soft- 
ness of the UV background (|Bolton et al.l [21306) from 
measurements of the HI to Hell column density ratio 
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obtained by combining HI and Hell Lya forest spectra 
(jZheng et al]l2004 : IShull eTaII[200l . 

3. THE PHOTOIONIZATION RATE FROM THE 
Lya FOREST 

We begin by deriving the hydrogen photoionization 
rate T implied our measurement of the Lya forest opac- 
ity. The method we employ is based on the mean 
level of absorption in th e forest and is te rmed the 
"flux decrement" method (|Rauch et al.lll997l) . For the 
reader who is not concerned with the details, we im- 
mediately present the results in Figure [lj with nu- 
merical values tabulated in Table [TJ The figure com- 
pares our measurement to previous estimates based on 
the flux decremen t method that overlap in redshift 
(IRauch et al.lll997l; iMcDonald fc Miralda-Escudl 120011: 
Meik sin fc White! 12004 ITvtler et al.l I20Q4J: iBolton et all 
2005; Kirkman et al. 2005). We refer to the appendix of 
Faucher-Giguere et alJ (|2008bl ) for a detailed numerical 
summary of the previous T measurements and to ij7.6l for 
a discussion. 
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Fig. 1. — Intergalactic hydrogen photoionization rate in- 
ferred from our Lya effective optical depth measurement (black 
squares) compared with existing measurements using a simi- 
lar flux decremen t method. The p revious measurements arc 
shown in gray: IRau ch ct al. (1997) (three-legged asterisks), 
IMcDonald fc Mira lda-Escudc (2001) (asterisks), Mei ksin fc White! 
(2004) (soli d squ ares), ITvtler etaLl ( 1 20041) (open s q uare) , 
Bolton et al. (2005) (solid triangles), and Kirkman ct al. (2005) 
(open triangle). Some of the previous measurements have been 
slightly offset in redshift in order to improve readability of the 
plot. 



3.1. Lya Effective Optical Depth 

The Lya effective optical depth is defined as 

T off (z) = -ln[(F>(z)], (2) 

where (F) (z) is the mean transmission of the Lya forest 
at redshift z. Neglecting redshift-space distortions, 

F = exp(-r), (3) 



'/Lya 1 R(T)nmin e 



m ^Lya H ( z > r 

is the local lGunn fc Petersonl (|1965l ) optical depth. Here, 
e and m e are the charge and mass of the electron, /l vq , 
and i'Lyq, are the Lya oscillator strength and frequency, 

H(z) is the Hubble parameter, R(T) is the temperature- 
dependent hydrogen recombination rate, nnn and n e are 
the proper number densities of HII and electrons, and T 
is the hydrogen photoionization rate. 

We consider a gas made purely of hydrogen and he- 
lium, with mass fractions X and Y, respectively. To 
describe its ionization state, we define (x, yu, yui) = 
(n H ii/"H, ^Hdi/^Hc, "Hcin/n-Hc)- Then 

Pcrit^ Z-b 



n-HH 



-xx(i + 6)(i + z y 



(5) 



and 



Per it* 'fc 



[Xx + 0.25Y(y u + 2yni)}(l + 6)(l + z) 3 , (6) 



where 5 is the local overdensity, and we have used the 
fact that a helium atom weighs approximately Am p . To 
a good approximation, 

R(T) « R T-°- 7 , (7) 

with Ra = 4.2 x 10" 13 cm 3 s-y(10 4 K)" 07 (e.g., 
iHui fc Gnedinlfl997[ l. and the Hubble parameter is given 
by the Friedmann equation, 

h(z) = H ^n rn (i + z)3 + n A . (8) 

Assuming that the intergalactic gas follows a power-law 
temperature-density relation of the form 

T = T (l + z)P (9) 

(|Hui fc Gnedmlll997h . equation (g]) implies that 



with 



A(z) = 



2 /l 



ya 



A(z)(l + S) 



( Pcrit^b 



2-0.7/3 



(10) 



1 



H(z) 

2ym)] 



^o^o 



■0.7 



-(i + zY 



m e"Lya 

Xx[Xx + 0.25Y(y u 

(11) 
Note that equation ([9]) is often expressed in term of the 
parameter 7 = (3 + 1 in the literature. An isothermal 
temperature-density relation corresponds to 7 = 1 or, 
equivalently, f3 = 0. 

Given a probability density function (PDF) for the gas 
density A = 1 + S, 



(F)(z) 



dAP(A;z)exp{-r) 



(12) 



Note that neglecting redshift-space distortions from ther- 
mal broadening and peculiar velocities is well-motivated 
here since (F) is to first order independent of the smooth- 
ing of the F field induced by these distortions. 3 For any 
specified (3, a measurement of r e ff(z) thus determines the 
evolution of A(z), which itself fixes the ratio T _0 ' 7 /r if 
the cosmological parameters and ionization state of the 
gas are known (eq. QT]). 

3 The mean of F is not strictly independent of redshift space 
distortions, since these really smooth the r field, of which F is a 
nonlinear function. This however amounts to a small effect. 
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3.2. Gas Density PDF 

IMiralda-Escude et al.l (|2000f ) derived an approximate 
analytical functional form for the volume-weighted gas 
density PDF, 

~ 2/3 -C )\_ 



Pv(A) = Aexp 



(A- 



2(2<5 /3) 2 



(13) 



This formula is motivated by the facts that the gas in 
the low-density voids, where gravity is negligible, should 
expand at nearly constant velocity, whereas the distribu- 
tion in high-density collapsed structures should be deter- 
mined by their power-law profile, A oc r '^ ' . 

The parameters A and Co are fixed by requiring the 
total volume and mass probabilities to be normalized 
to unity. Fits to a numerical simulation at z =2, 3, 
and 4 yields the parameters given in Table with 
Sq = 7.61/(1 + z); at z — 6, b = 2.5, corresponding 
t o isothermal halos, is assumed. 

iRauch et al.l (|1997h compared the density distributions 
from simulations using very different numerical methods 
(Eulerian versus Lagrangian smoothed particle hydrody- 
namics) and cosmologies (ACDM vs. Einstein-de Sitter). 
They found excellent a greement in spite of the diffe rent 
simulation parameters. IMiralda-Escude et al.l (|2000f ) at- 
tributed this similarity to the fact that the density dis- 
tribution should depend mostly on the amplitude of the 
density fluctuations at the Jeans scale, both simulations 
having approxima tely the same. 

Our use of the IMiralda-Escude et all (|2000l ) PDF in 
deriving T is certainly an imperfect approximation. In 
general, the details of the gas density PDF will depend 
on the exact cosmological model (in particular through 
the power spectrum of density fluctuations) , the thermal 
state of the gas, as well as on the nu merical properties of 
the simulation. iBolton et al.l (|2005l ). in particular, stud- 
ied the dependences of the inferred photoionization rate 
on these parameters, demonstrating that they have a sig- 
nificant effect and quantifying their importance. Possibly 
of equal importance, however, is the entire thermal his- 
tory of the Universe. In fact, the gas spatial distribution 
(through Jeans-like smoothing) depends not only on the 
present temperature of the gas, but also on its past state 
as it takes times for the gas to respond to changes (e.g., 
iGnedin fc Huil fl998[ ). In addition, fluctuations in the 
magnitude of t he UV background and associated heat- 
ing rates (e.g., iMeiksin fc W hite 20Q3), the inhomoge- 
neous reionization o f both hydrogen and helium (e.g., 
Hui fc Haiman] 120031: lLai et al.l 12005 iFurlanetto fc Ohl 



2007allbD . and secondary feed back effects from galax y for- 



mation and evolution (e.g.. iKollmeier et al.ll2006T ) may 
also affect the detailed properties of the intergalactic gas. 
A full investigation of these effects is beyond the scope 
of the present paper. 

In what foll ows, we instead take a sim ple approach 
based on the IMiralda-Escude et all (|2000f ) PDF in de- 
riving the hydrogen photoionization rate, focusing on its 
implications for the ionizing sources. To estimate the ef- 
fect of this assumed PDF, we have repeated our analysis 
with the gas density PDF from the Q5 hydrodynamical 



4 Note that Miralda-Escudc ct al. (2000) use the notation for 
b. We have altered their notation in order to avoid confusion with 
the temperature-relation slope parameter defined in this work (eq. 
0. 





TABLE 2 




IMlRALDA 


ESCUDE ET AL 


.1 (120001) 


Gas Density PDF Parameters 


z A a 


8 b 


Co 



2 0.176 2.54 2.23 0.558 

3 0.242 1.89 2.35 0.599 

4 0.309 1.53 2.48 0.611 
6 0.375 1.09 2.50 0.880 



The values 



given 



n by 
IMiralda-Escude et all " (I2000T) 
are off by a factor of In 10. 

simulation of ISpringel fc Hernquistl (|2003bl ). This sim- 
ulation of a ACDM universe with (fi m , $7a, h, as) — 
(0.3, 0.7, 0.7, 0.9) has a box side length of 10 h~ x Mpc, 
with 324 3 dark matter particles and as many baryonic 
ones. This PDF yield s a T at z = 3 highe r than the 
one inferred using the IMiralda-Escude et al.l (|2000f ) by 
~ 10%, all other parameters fixed. While this is a non- 
negligible effect, it is comparable to the statistical error 
we quote (Table Q]) and it is relatively small in compar- 
ison with the total plausible systematic error, the mag- 
nitude of which can be estimated from the scatter be- 
tween the existing measurements (Figured]). We caution 
that more work is clearly needed to refine the accuracy 
of the measured T, but note that the conclusions that 
we develop here are broadly robust to an order unity 
uncertainty in its normalization that may reasonably be 
expected. On the other hand, our results are consis- 
tently derived and finely binned over a large redshift 
range, clearly constraining the constancy of T barring 
any strongly rcdshift-dcpendent systematic effect. 

3.3. Thermal History of the IGM 

Although the thermal history of the IGM may only 
have a modest effect on the gas density PDF, the pa- 
rameters Tq and P must be known in order to unambigu- 
ously solve for the evolution of the background hydrogen 
photoionization rate, T. In this paper, we do not at- 
tempt to infer To and (3 directly from the data; rather, we 
use existing measurements, which we combine with our 
theoretical understanding of the thermal physics of the 
IGM in order to assess the robustness of our conclusions. 
We begin by reviewing this physics before examining the 
present observational constraints. 

3.3.1. Theory of the Thermal History of the IGM 

A detailed formal ism for the thermal history of the 
IGM can be found in lHu i & Gncdin (19971) , or m ore con- 
cisely in the appendix of iHui fc Haiman] (|2003l ). As we 
will ultimately base our analysis on empirical measure- 
ments, we simply summarize the most important physi- 
cal processes here. 

For given initial conditions, the temperature of a given 
fluid element is uniquely determined by a competition be- 
tween cooling and heating processes. In the low-density 
(^ ^S 5) IGM of the z < 10 Universe, photoheating and 
adiabatic cooling typically drive the thermal evolution. 
Photoheating proceeds in two main regimes. During 
reionization events, the ionization fraction of a particular 
atomic species (with H and He being most important by 
a large factor) changes by a factor of order unity, induc- 
ing a large boost in the IGM temperature. In an already 
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ionized plasma, photoheating occurs through the ioniza- 
tion of small residual fractions of HI, Hel, or Hell. In 
equilibrium, this process is balanced by recombinations. 
Gas elements further heat or cool simply because of adi- 
abatic contraction or expansion; the overall expansion of 
the Universe, for example, induces a temperature fall-off 
Tcx(l + z) 2 . 

Ultimately, the IGM temperature loses memory of 
rcionization events, reaching a "thermal asymptote" de- 
termined by the balance between heating and cooling 
processes in the ionized plasma. The thermal asymptote 
depends only on the shape of the background spectrum. 
For a power-law ionizing background J„ oc v~ a it is given 

by 

T =2.49 x 10 4 K(0.417 + 0.047y n + 0.583y m ) (14) 



is to consider its transmission small-scale power spec- 
trum. In this case, the finite tempe rature of the 
gas s u ppresses the s mall-scale power (e.g.. ITheuns et al.l 



2000; Theuns & Zaroubi 2000; Zaldarriaga ct al. 2001 



x (2 + a) 



-1/1.7 



1 + z 
4.9 



0.53 



dHui fc GnedinlH99l . 

What are relevant initial conditions? Hydrogen reion- 
ization can heat the I GM b y a few times 1 0^ K 

(iMiralda-Escude fc Reed 119941; Ubel fc Haehneltl 119991 : 
iTittlev fc Meiksinll2007l ). with negligible pre-reionization 
temperatur es ~ 10 3 K expected from hea ting by X-rays 
dOht [20011: IVenkatesan et al.l 120011 : iKuhlen et all 120061: 
iFurlanetta l2006f ) . While we know for certain that the 
Universe is reio nized by z = 6 from quasar spectra (e.g., 
iFan et afll2006[ ). the Thomson scattering optical depth 
measured by WMAP (|Spergel et al.ll2007l) indicates that 
it is likely to have proceeded at z < 20. Similar entropy 
injection may occur at lower redshifts (z ~ 3 — 4) duri ng 
the reionization of Hell (e.g-. lFurlanetto fc Oh]|2007rJ) . 

The parameters (To, 0) of the temperature-density re- 
lation (eq. [9]) can in principle be solved for by calculat- 
ing the evolution of the temperature of fluid elements as 
a function of density. Uncertainties in the redshifts of 
reionization events and their character, and on the evo- 
lution of the ionizing background spectrum however pre- 
clude a reliable ab initio calculation of the temperature- 
density relation. We therefore turn to empirical esti- 
mates. 

3.3.2. Thermal History Measurements 

The thermal evolution of the IGM can be probed using 
the Lya forest itself. Indeed, the Jeans-like smoothing of 
the gas depends on its pressure, which in turn is set by 
its temperature. In addition, Lya forest spectral features 
are thermally broadened. Both of these effects increase 
the characteristic width of Lya absorption lines. 

In general, Hubble broadening (arising from the dif- 
ferential Hubble flow across individual absorbers) and 
peculiar veloci t ies also contribute to the line widths 
(Mei ksTnl 11994 IWeinberg et al.l Il997ri iHui fc Rutledgel 
119991: iTheuns et al.ll2000h . On "velocity caustics," where 
the peculiar velocities of the gas particles cancel the Hub- 
ble gradient, however, the line width should be uniquely 
determined by the gas temperature. This results in a 
cut-off in the distribution of line width versus column 
density t hat traces the temperature-density relation of 
the gas (ISchave et al 1 119991 . 120001 : iRicotti et all 120001 : 
iMcDonald et al.ll2001h . 

An alternative, but physically related, method to 
estimate the IGM temperature from the Lya forest 



ITheuns et aT1l2002t IZaldarria ga 2002). Z aldarriaga et all 
(|2001h used this dependence of the small-scale power 
to jointly estimate To and /3 from the power spec- 
trum measurement fro m eight Keck/HIRES spectra of 
IMcDonald et al.l (|2000l ). The la constraints on T ob- 
tained after marginalizing over (3 are To = (2.10±0.45) x 
10 4 K at z = 2.4, T = (2.3 ±0.35) x 10 4 K at z = 3, and 
To = (2.2 ± 0.2) x 10 4 K at z = 3. 9 5 

We adopt the IZaldarriaga et al.l (120011) va l ues, c onsis- 
tent with those obtained bv lMcDonald et all (|200l| ) from 
the same data set but with an independent line-fitting 
method, in our analysis. In the range 2.4 < z < 3.9, we 
linearly interpolate between their To measurements; for 
z < 2.4, we linearly extrapolate based on the z = 2.4 
and z — 3 values. In our fiducial model, we assume that 
the IGM has been cooling adiabatically, To oc (1 + z) 2 , 
for z > 3.9. For the slope of the temperature-density 
relation, we take the early reionization limit [3 = 0.62. 

The la errors in our inferred T (Figure [1] and Table 
[1]) include both the uncertainty in our r e g measurement 
and on Tq. 

3.4. Ionization State of the IGM 

We adopt the mass fractions X = 0. 75 and Y = 
0.25 for hydrogen and helium, respectively (|Burles et al.l 
2001). At the redshifts z < 6 of interest, quasar spectra 
indicate that the Universe is fully ionized, x = 1, to bet- 
ter than one part in a thousand. While helium is likely 
also almost fully ionized at z < 3 (j/n = 0, g/ni = 1), as 
indicated by observations of the Hell Lya forest, little 
is known about its ionization state at higher redshifts. 
Owing to its similar ionization potential, helium is ex- 
pected to be singly ionized simultaneously to hydrogen. 
A number of observational lines o f evidence (for a review, 
see lFaucher-Giguere et alJl2008d ) a s well as observation- 
ally calibrated theore t ical model s (Sokasian ct al. 2002; 
IWvithe fc Loebl 120031: iFurlanetto fcO h 2007b) suggest 
that Hell is reionized around z = 3 — 4. In our infer- 
ence of r, we assume that helium is fully ionized at all 
epochs probed; T may be overestimated by up to 8% 
at the highest redshifts if our measurement reaches pre- 
Hell reionization times, owing to an overestimate of the 
number of free electrons (eq. |6|) . 

3.5. Systematic Effects from the Thermal History 

We conclude this section by exploring systematic ef- 
fects that may arise if our assumptions regarding the 
thermal history of the IGM are in error with respect to 
our derived photoionization rate. 

3.5.1. Temperature at Mean Density 

For fixed cosmology, ionization state of the IGM, and 
temperature-density relation slope [3, r c g constrains the 
quantity T -0 ' 7 /r fi j3.ip . An error in the temperature of 
the IGM at mean density, To, will therefore directly re- 
sult in a corresponding error in the inferred T. Although 
our error bars on T include a contribution from the sta- 
tistical uncertainty in the measured To, it is conceivable 

5 These values are given at la in Hui & Haiman (2003). 
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that these measurements suffer from systematic effects. 
Figure [2] shows exactly how the inferred T depends on 
the assumed T at z = 4. We focus on this particular 
rcdshift as we will be interested in the robustness of a 
high r at the highest redshifts probed when we consider 
the sources of the UV background ( §5. 3ft . 
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Fig. 2. — Inferred hydrogen photoionization rate at z = 4 as a 
function of the assumed temperature of the IGM at mean density. 
The dashed lines show the statistical error in the derived V from 
the error in the measured r e ff only. The vertical line indicates the 
temperature at m e an de nsity To = (2.2 ±0.2) X 10 4 K measured by 
IZaldarr iaga et al. ( 200111) at z = 3.9. The shaded area covers the 
la interval on this measurement. All other parameters as in our 
fiducial inference. 



Note that the slight upward bump 6 near z = 3.2 in the 
derived T (Fig. Q]) may be an artifact of our smooth inter- 
polation of the temperature between the sparse measure- 
ments at z ~ 2, 3, and 4. This procedure directly trans- 
lates a downward bump in T e s into an upward bump in T. 
An alternative possibility is that the evolution of T is fea- 
tureless and that To instead undergoes a rapid increase, 
for example owing to the reionization of Hell (theoreti- 
cal work however suggests that the time scale for heating 
the IGM during Hell reionization is too long to explain 
such a narrow feature; iBolton et a l. 2008; Mc Quinn et al.1 
2008). For a discussion of th ese degenerate effects, see 
Faucher-Giguere et al.l (|2008cD . The detection of a bump 
in r e g is more robust in that it is not subject to this de- 
generacy. 



3.5.2. Slope of the Temperature- Density Relation 



° The statistical significance of this feature is greater in the T e ff 
evolution than in the derived evolution of T, as the statistical errors 
in the latter include contribution from the error in Tq which is 
cor related between bins. For an analysis of this feature in T a g , 
see Faucher-Giguere et al. (2008c). 



From line- f itting analyses, iRicotti et al.1 (|2000f ) and 
ISchave et al.l ([2000) have found some (albeit marginal) 
evidence that the temperature-density relation becomes 
isothermal near z rs 3, perhaps owing to reheating from 
the reionization of Hell near this redshift. Comparing 
an improved measur ement of the Lya forest flux PDF 
at 1.7 < z < 3.2 by iKim et ail (|2007l ) to a large set of 
hydrodynamical simulations with di fferent cosmologica l 
parameters and thermal histories, IBolton et al.l (2007) 
find evidence for an equation that is close to isother- 
mal, or even inver ted (0 < 0) . From a data set ex- 
tending to z = 5.8. lBecker et al.1 (|2007h also find sugges- 
tive evidence that an inverted temperature-density re- 
lation with (3 rj —0.5 fits the observed Lya flux PDF 
be st, if the underlying gas d ensity PDF follows that 
of iMiralda-Escude et all (|200Ct ). This suggests that the 
voids in the IGM may be significantly hotter and the 
thermal state of the low-density IGM more complex than 
previously assumed. Thes e claims have no t been cor- 
roborated by the r esults of iMcDonald et ail (J2001I ) and 
IZaldarriaga et all (|2001h . although both these analyses 
are consistent with isothermality at z < 3. 

While the present observational evidence is scarce 
and difficult to interpret, some theoretical modeling 
of inhomogeneous Hell reionization also suggests a 
compl ex, possibly inverted te mperatu re-density relation 
(Bolton et al. 2004; Glcscr et al. 20051; iTittlev fc Meiksinl 
l2007t IFurlanetto fc Ohll2007al ). Detailed radiative trans- 
fer simulations of Hell reionization however find that 
the slope of the temperature-density relation is only 
moderately affected and that in actuality the correct 
slope is somewhere between the early hydrogen reion- 
ization limit (/3 = 0.62 ) and the isothermal case (/3 = 0) 
([McQuinn et al.ll2008f h These simulations also produce 
a large scatter in the temperature-density relation, sug- 
gesting that a power-law approximation is rather rough 
during Hell reionization. 

How does the uncertainty in the slope of the 
temperature-density relation of the low-density IGM af- 
fect our inference of T? In Figure [3l we repeat our cal- 
culation of r as determined from our effective optical 
depth measurement varying (3. We consider, in addition 
to the early hydrogen reionization limit, isothermal and 
inverted (/3 = —0.5) temperature-density relations. The 
latter is cons i stent w ith t he best-fit pa r amete rs found by 
IBolton et all (|2007l ) and iBecker et al.l (|2007l ). but likely 
too extrem e to be physically reali stic based on the cal- 
culations of lMcQuinn et al.l (|2008f ). 

As the temperature-density relation becomes flatter or 
inverted, the inferred T at z > 2 decreases, indicating 
that the Lya forest becomes more sensitive to under- 
dense regions with 5 < 0. This is increasingly the case 
at higher redshifts. Near z — 2, the inferred T is nearly 
independent of the slope of the temperature-density re- 
lation (indicating that the measurement is most sensitive 
to S ~ 0), while at z = 4 the early-reionization limit gives 
a r that is about twice that of the inverted case. 

Note that the systematic uncertainties in the tempera- 
ture of the IGM at the mean density To and on the slope 
of the temperature-density relation /3, especially if they 
conspire to affect the inferred T in the same direction, 
could go some way in resulting in a declining photoion- 
ization rate toward high redshifts z > 3 and therefore 
bringing it in better agreement with observationally de- 
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Fig. 3. — Dependence of the inferred hydrogen photoionization 
rate on the low-density IGM temperature-density relation slope 
/3 = y — 1 (eq. [9$. We show the results for the early reioniza- 
tion limit, the isothermal case, and an inverted relation. As the 
temperature-density relation becomes flatter or inverted, the in- 
ferred r at z > 2 decreases, indicating that the Lya forest becomes 
more sensitive to underdense regions with 8 < 0. This is increas- 
ingly the case at higher redshifts. Near z = 2, the inferred T is 
nearly independent of the slope of the temperature-density rela- 
tion, while at z = 4 the early-reionization limit gives a T that is 
about twice that of the inverted case. All other parameters as in 
our fiducial inference. 



rived star formation rates (see H5.3[) . However, the re- 
quirement that the Universe be reionized by z — 6 also 
argues forcefully against a steep decline of star forma- 
tion beyond z = 3 (i i5.5|) . The latter argument, depend- 
ing only on the magnitude of T at z = 3 through the 
normalization of the ionizing emissivity, is largely insen- 
sitive to the uncertainties in the thermal history at the 
redshifts probed by our Lya forest opacity measurement. 

4. FROM PHOTOIONIZATION TO EMISSIVITY 

Although T is clearly related to the cosmic sources of 
ionizing photons, the sources are most closely related to 
their specific emissivity, e„. In this section, we compute 
the UV emissivity implied by our inferred photoioniza- 
tion rate, before proceeding to investigate its implica- 
tions for quasars and star- for ming galaxies in t h e next . 
Our formalism is based on lHaardt fc Madaiil (1 19961) , 
iMadau et all (fl999h . and lSchirber fc Bullockl (120031 ). 



4.1. Radiative Transfer 

This specific intensity of the UV background obeys the 
cosmological radiative transfer equation, 



d_ 
di 



vH 



d_ 

dv 



J, 



-3HJ„ 



ca v J v 4- — e h 

47T 



(15) 



where H(t) is the Hubble parameter, c is the speed of 
light, a v is the proper absorption coefficient, and e„ is 
the proper emissivity. Integrating equation (|15p and ex- 



pressing the result in terms of redshift gives 
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e v {z) exp[-r(i'o, z , z)], 



dz (1 + z) 3 

(16) 
where v = ^o(l + z )/(l + z o)i the proper line element 
dl/dz = c/[(l + z)H(z)], and f quantifies the attenua- 
tion of photons of frequency v Q at redshift z$ that were 
emitted at redshift z. For Poisson-distributed absorbers, 
each of column density N-ri , 



t(v ,zq,z) = I dz' 



dN } 



HI 
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dN m dz 
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where d 2 N/ dNmdz' is the column density distributio n 
versus redshift and r„ = -/Vhictht(^) (|Paresce et all igSO). 
We neglect the continuum opacity owing to helium and 
heavier elements, which is a good approximation near 
the hydrogen Lyman edge. For the redshifts z > 2 of 
interest here, the mean free path Al(is) of UV ionizing 
photons is so short that the sources contributing to T at a 
given point ar e largely local. In this loc al-source approx- 
imation (e.g.. ISchirber fc Bullockl 120031 ). the solution to 
equation (Til))) reduces to 



'in 
We may thus trivially solve for the emissivity, 

Mz) 



e u (z) K, 47T 
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4.2. Mean Free Path 

As the mean free path of ionizing photons is the key 
quantity relating T to its sources, we pause to derive an 
improved value in the light of new data and estimate its 
uncertainty. We assume that the column density distri- 
bution of absorbers is well-approximated by power laws 
of the form 



d 2 N 



= JV„JV(1- 



zV 



dNmdz 
in which case the general solution to equation (fT7|) is 

T(2-(3) 
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xJV, 






(/3-l)( 7 -3/3 + 4) 
zo) 3(/3 - 1} 



4t\i 



(i + z r-^ +4 ] 



(21) 



Here, T(2 — 0) is the gamma- function and is not re- 
lated to the photoionizatio n rate. This reduces to the 
expression given by IMadau et al.l (|1999) in the special 
case (/3, 7) = (1.5, 2). The mean free path is obtained 
by differentiating, setting Af = 1, and using the line 
element dl/dz to convert to proper length: 



AZ(i/ , z) 
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"(l + z)-r +1 H(z)' (22) 

For steep column density distributions with f3 ~ 1.5, 
as suggested by observations, most of the contribution to 
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f at the Lyman limit arises for systems of optical depth 
near unity (TVhi ~ 10 172 cm -2 ). We thus focus on the 
values of the power-law indexes j3 and 7 that are most 
appro priate in this neighborhood. IStengler-Larrea et al.l 
(fl995h find that dN/dz = C{\ + z)~< with C = 0.25to;!o 
and 7 = 1.50 ±0.39 for systems with N m > 10 172 cm -2 , 
whereas the colu mn density distributi on is well-fitted by 
13 = 1.390±0.027 (IMisawa et al.ll2007l ). The constant N 
in equation (gHl) is related to C by N a = (0-J)CN% ^„ , 

where iVHi,min = 10 17 ' 2 cm -2 is the minimum column 
density accounted for in dN/dz. 

Figure |4] shows the corresponding mean free path at 
the Lyman limit, A/ rs 85[(1 + z)/4]~ 4 proper Mpc, and 
its propagated uncertainty. The smaller errors take into 
account only the uncertainty in the redshift evolution 
of the mean free path (7). Also shown is the com- 
monly used result of iMadau et~aTl (J1999D . AZ Madau w 
33 [(1 + z)/4]~ 4 - 5 proper Mpc, which is seen to under- 
estimate our value by a factor « 2.5, albeit within the 
uncertainty. The redshift evolution differs by a power 
of 0. 5 as we have adopted t he po wer-law index (3 = 1.5 
from IStengler-Larrea et all (|1995l ) for the redshift evolu- 
ti qn of Lyman limit systems, con sistent with the results 
o flStorrie-Lombardi et al.l (|1994fl . 

IMadau et alJ (|1999l ) motivate their steeper choice 
of 7 = 2 from measurements of the redshift evolu- 
tion of optically thin systems of lower column densit y 
dPress fc Rvbicki|[l99l : lBechtoldlfl99llKim et al J 1 1991 . 
However, if, for example, Lyman limit syst ems are asso- 
ciated with the outs kirts of galaxies (e . g.. lTvtlerj[l982| 
Bechtold et~al| 11984 iKatz et al.l Il996bt lLanzettal | 1988| 
Sargent et al.l 1 19891: ISteidell Il990t IMisawa et all I2OO4I 
Kohler k. Gnedirj 12007). then their evolution may not 
follow that of absorbers in the diffuse IGM. We therefore 
prefer to use the column density distribution measure- 
ments directly probing Lyman limit systems. Although 
it is true that lower column density systems contribute 
non-negligibly to the Lyman continuum opacity, we note 
that instead choosing 7 = 2 would lead to a steeper de- 
crease of the mean free path with increasing redshift. 
This in turn would result in a larger requirement on the 
ionizing emissivity in order to produce the observed pho- 
toionization rate, exacerbating the tension we find in £ 15 . 31 
and §6.31 with some estimates of the star formation rate 
density at high redshifts. In this sense, our choice is con- 
servative and our conclusions would only be strengthened 
if we had significantly underestimated the redshift evo- 
lution of the absorption systems determining the mean 
free path. 

We finally note that even for identical choices of 
(No, (3, 7), o ur estimate of the m ean free path would 
exceed that of Ma dau et al.l (|1999f ) by about 30% owing 
to their assumption of an Einstein-de Sitter cosmology, 
in contrast to the WMAP cosmology we adopt. 

4.3. Emissivity 

We finally turn to the calculation of the emissivity at 
the Lyman limit implied by our measurement of Y, As- 
suming that the ionizing background has a power-law 
spectrum J„ = Jir H1 (y/vm)~ a ' ia blueward of the Lyman 
limit, 
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Fig. 4. — Mean free path of photons at the Lyman limit ver- 
sus redshift. The thick solid curve shows our calculation based 
on the column den sity distribution of absorbers measured by 
Misawa et al. (2007) and the redshift number density reported by 
StcnKlcr-Larrca et al. (1995). The bounding thinner solid curves 
indicate the propagated uncertainty in the mean free path. The 
dotted curves show the errors taking into account only the uncer- 
tainty in the redshift evolution of the mean free path (7). The 
bl ue long-dashed curv e shows the commonly used mean free path 
of lMadau eFaTI (H999T) . 
from which 
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or, equivalently, 

T(z) 



o-hiAZ(^hi, z)e„ HI (z) 
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We are also interested in the rest-frame UV emissivity 
probed by optical quasar and galaxy surveys. Following 
the galaxy survey literature, we define the UV emissivity 
euv to correspond to the wavelength 1500 A, and denote 
the corresponding frequency by fuv- If «uv is the spec- 
tral index between the Lyman limit and 1500 A, then 

_^/1500A^ Quv 



euv 



/esc V 912 A 



(26) 



The escape fraction / csc accounts for the fact that, owing 
to Lyman continuum opacity associated with the host 
halo, only a certain fraction of the photons blueward of 
the Lyman limit escape from their source. The correct 
value depends on the nature of the sources, to which we 
now turn. 

5. THE COSMIC SOURCES OF UV PHOTONS 

The two known dominant sources of UV photons in 
the Universe are quasars and star- forming galaxies. We 
investigate the constraints that can be put on their pop- 
ulations using our measurement of the IGM Lya opacity. 

Our starting assumption is that the luminosity func- 
tion of quasars and their spectral energy distribution 
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(SED) are better constrained than those of galaxies. In 
addition, we assume that all the photons capable of ioniz- 
ing hydrogen emitted by quasars escape their host unim- 
peded, i.e. that quasars have an escape fraction of unity. 
This is often assumed to be the case on the theoretical 
basis that quasars are suffic iently powerful to f ully ionize 
their surrounding gas (e.g.. lWood fe Loebll2000f) . Obser- 
vational evidence that this is the case is provided by the 
proximity effect, which is clearly detected at roughly the 
level predicted if the SED of quasars does not suffer a 
break at the Lyman limit from intrinsic absorption (e.g., 
Scott et alJl200CHGoncalves et al.ll2007l : iDall'Agrio et all 



2008). Moreover, quasar spectra generally do not show 



DLAs associated with the quasar hosts. In contrast, 
DLAs of high column density are seen in most spec- 
tra of long-duration gamma-ray bursts occurring in star- 
forming galaxies and their Lyman-continuum opacity is 
understood to be respon sible for the sma l l escape frac- 
tion o f inactive galaxies (|Chen et al.ll2007t iGnedin et al.1 
12007ft . 

5.1. Quasar Emissivity 

Hop kins et al.l (|2007ft have used a large set of observed 
quasar luminosity functions in the infrared, optical, soft 
and hard X-rays, as well as emission line measurements, 
combined with recent estimates of the quasar column 
density distribution from hard X-ray and IR observa- 
tions and measurements of their spectral shape from the 
radio through hard X-rays to estimate their bolometric 
luminosity function. Denoting by £3 the emissivity at 
4400 A and assuming Lb = vL v \ 



dL f 



'4400 A' 

L B 



cLLb v 



(27) 



'4400 A 

w here dcj^/dLs is the -B- band luminosity function derived 
by iHopkins et al.l (|2007[ ) from their full spectral and ob- 
scuration modeling in comoving units. To convert to an 
emissivity at the Lyman limit, we assume that quasars 
have a spect ral index a = 0.3 at 2500-4400 A, 0.8 at 
1050-2 500 A ([Madau et aLlll999f ). and 1.6 from 1050 A to 
228 A (jTelfer et al.ll2002ft . The corresponding photoion- 
ization rate is then obtained using equation (|24p . 

Although equation [27] appears to assume isotropic 
quasar emissivity, it is more generally valid. For in- 
stance, if quasars emit with constant intensity in some 
directions and are completely obscured toward the oth- 
ers, then the overestimate of the total photon output of a 
quasar based on its observed magnitude and the assump- 
tion of isotropy will be exactly canceled by the fraction 
of quasars missed in the luminosity function. To gen- 
eralize further, note that in a context in which quasars 
shine with different intensities in different directions, the 
observed quasar luminosity function can be interpreted 
as quantifying the number of (randomly oriented) lines 
of sights of given intensity from quasars. For the pur- 
pose of calculating the cosmological emissivity, one can 
imagine distributing these sight lines among isotropically 
emitting sources and recover equation l27l 

Some biases could however be introduced in the calcu- 
lation if the angular distribution of the quasar intensity 
has a more complex smoothly varying profile or depends 
on frequency (see §5.3|) . 

We take a background spectral index shortward of the 
Lyman limit «hi = 0.1, appropriate if the spectrum is 



hardened by IGM filtering. This hardening arises from 
the frequency dependence of the mean free path of ion- 
izing photons (eq. |2"2"|) and the relation between the UV 
background spectrum and the emissivity producing it 
(eq. \lU\i : J v ex e^ 3 ^" 1 ). Taking the approximate value 
/3 = 1.5 for the column density distribution of absorbers, 
the spectrum is hardened by a — > a — 1.5. 7 

5.2. Stellar Emissivity 

Because only massive short-lived stars produce UV 
photons in significant amounts, the stellar emissivity is 
intimately connected to the cosmic SFR. To calculate 
the stellar contribution to the emissivity of ionizing pho- 
tons, we consider both theoretical (Springel & Hernquist 
l2003ri [Hernquist & Springel 200 3|) and observation al es- 
timates ([Hopkins! 12004; H opkins fc Beacoml 12001 and 
references therein) of the cosmic star formation history, 
which we describe in i )5.2.11 

The exact calculation of the emergent emissivity of ion- 
izing photons from galaxies involves detailed assumptions 
about the initial mass function (IMF) of stars, stellar as- 
trophysics, and the escape fraction of ionizing radiation, 
all of which are subject to substantial uncertainty. Un- 
der the assumption that these are constant across cosmic 
time, however, the emissivity is simply proportional to 
the SFR density, 

e u = Kp*(l+z) 3 , (28) 

where the factor of (1 + z) 3 arises from the conversion 
from comoving SFR density to proper emissivity in our 
notation, and the constant K depends on the uncertain 
astrophysics. The usefulness of this description arises 
from the fact that significant insight can be gained from 
the redshift evolution of the emissivity only. If the proper 
mean free path evolves as A^ ex (1 + z)~ 4 (appropriate if 
the linc-of-sight number density of Lyman limit systems 
evolves as dN/dz oc (1 + z) 1,5 ; £|4.2[) . then we can use 
the local-source approximation in equation (I18p to relate 
the evolution of the comoving SFR density to that of the 
hydrogen photoionization rate: 

r = K'p*(l + z)- 1 , (29) 

for some other constant K' . 

5.2.1. Star Formation Rate Density 

Employing hydrodynamic simul ations of structure for- 
mation in a ACDM cosmology, ISpringel fc Hernquist! 
(2003b) calculated the comoving SFR density p*(z), tak- 
ing into account radiative heating and cooling of the gas, 
star formation, supernova feedback, and galactic winds 
based o n the hybrid star-forma t ion mu ltiphase model de- 
tailed in I Springel fc Hernquistl (j2003al ). They obtained a 
SFR density gradually rising by a factor of ten from z = 
and peaking at z ~ 5 — 6. Using simple analytic reason- 
ing, iHernquist fc Springel! (|2003l ) identified the processes 
that drive the evolution of the cosmic SFR in CDM uni- 
verses, and derived an analytic model matching their sim- 
ulation results to better than w 10%. 

7 Note that this differs from the maximum hardening a — > a — 3 
that would result from a homogeneous distribution of neutral hy- 
drogen because of the <r(y) oc v~ 3 photoionization cross-section de- 
pendence. The difference arises from the distribution of absorbers 
into discrete clumps and depends on the slope of the column den- 
sity di stribution. See, for example, the argument in Zuo & Phimicy 
119931) . 
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They found that the cosmic SFR is described by two 
regimes. At early times, densities are sufficiently high 
and cooling times sufficiently short that abundant quan- 
tities of star-forming gas are present in all dark mat- 
ter halos that can cool by atomic processes. In this 
gravitationally-dominated regime, p* generically rises ex- 
ponentially as z decreases, independent of the details of 
the physical model for star formation, but dependent on 
the normalization and shape of the cosmological power 
spectrum. At low redshifts, densities decline as the Uni- 
verse expands to the point that cooling is inhibited, lim- 
iting the amount of star-forming gas available. In this 
regime, the SFR scales in proportion to the cooling rate 
within halos, p± oc iJ(z) 4 / 3 . 

These two regimes lead to a redshift of peak star for- 
mation which in general depends on the efficiency of star 
formation. For a star formati on efficiency normalized to 
the empirical Kennicutt law (|Kennicuttlll989l . Il998bl ) of 
disk galaxies at z = 0, the comoving SFR density in their 
simulations is well described by the analytic form 



/>*(*) = p*(0) 



X 



1 + a( X - I) 3 exp (/3x 7/4 ) : 



where 



X 



H(z) 



2/3 



(30) 

(31) 



and a = 0.012, (3 = 0.041, and p*(0) = 0.013 M Q yr" 1 
Mpc~ 3 are fitting parameters. 

This fit was derived for their ACDM cosmology 
with Q m = 0.3, n A = 0.7, h = 0.7, and a$ = 
0.9. For consistency, in this paper we use a modifi- 
cation of this fit adapted to the WMAP cosmology 
th at we assume. Spec i fically , we use equation (45) 
of iHernquist fc Springell (|2003l ) to evaluate their ana- 
lytic model for the WMAP cosmology. The resulting 
star formation history differs from their fiducial ACDM 
model through the parameter og governing the ampli- 
tudes of density fluctuations. Specifically, star formation 
is slightly delayed for eg = 0.82 with respect to the higher 
value as = 0.9. 

Extending prio r wor k by iHopkinsi (|2004l ). 
iHopkins fe Beacoml (|2006[ ) examined the observa- 
tional constraints on the cosmic star formation history 
based on a database of measurements in all relevant 
wavebands. To the luminosity density measurements, 
dust corrections (where necessary), SFR calibrations, 
and IMF assumptions are applied to derive the star 
formation history. These authors chose to use the 
parametric form of lCole et al.l (|2001f ) for their fits to the 
star formation history: 



P*0) 



(a + bz)h 
l + (z/c) rf ' 



(32) 



where h = 0.7. For a "m odified Salpeter A" IMF 
(jBaldrv fc Glazebrookl I2003D . they find the best-fit 
parameters (a, b, c, d) — (0.0170, 0.13, 3.3, 5.3). 
Other IMF s, such as the one advocated by 



iBaldrv fc Glazebrookl (|2003h . affect this fit only in 
its overall normalization, provided they are constant 
with cosmic time. The IMF normalization will be 
irrelevant for the following arguments and we therefore 
only consider the modified Salpeter A case. 



Although we w il l foc us on the widely used 
IHopkins fc Beacoml (|2006) fit for convenience in 
our study, we note that it is representative of many 
other current state-of-the-art observational estimates 
of the SFR density in that i t peaks at z = 2 — 3 and 
subsequently declines (e.g., iReddv et alJ l2008f). In 
additi on to the smoot h fit based on the ICole et all 
(|2001l ) parametric form, IHopkins fc Beacoml (|2006t ) also 
present a piecewise linear fit of the same data in order to 
avoid artifacts resulting from the choice of a particular 
functional form. We have duplicated our analysis with 
their piecewise linear fit as well and reached practically 
identical conclusions. To simplify our presentation, we 
only show our calculations for the smooth fit. 

5.3. Comparison with the Lya Forest Photoionization 

Rate 

To compare the photoionization rate measured from 
the Lya forest to what can be accounted for by the ob- 
served quasars and estimated star formation history, we 
proceed as follows. We begin by fixing the quasar con- 
tribution, with the working assumption that it is better 
constrained than that of stars. For each star formation 
history we consider, we then solve for the constant K' in 
equation (|29p that minimizes the x 2 between our mea- 
sured r and the sum of the quasar and stellar contribu- 
tions. We repeat the exercise for different normalizations 
of the quasar contribution to investigate how our conclu- 
sions would be affected if the escape fraction of quasars 
were less than unity, or if there were an error in the 
normalization of the mean free path or in the assumed 
spectral indexes. 

The results are shown in Figure [5) The superpositions 
of the best-fit nearly flat co n tribut ion to T from stars 
in the IHernquist fc Springe] (|2003f ) model and of the 
qua sar contribution peak ed near z ss 2 estimated from 
the IHopkins et all (2007) luminosity function match the 
observed total photoionization rate from the Lya forest 
reasonably well (panel A). However, if the stellar ioniz- 
ing em issivity instead traces the fit of Hop kins fc Beacoml 
(2006) to the SFR density, then the stellar contribution 
to r peaks similarly to that of quasars near z ~ 2. As 
a result, any superposition of the two contributions also 
peaks near z « 2. As the measured total T is nearly 
flat between z — 2 and z — 4.2, any such superposition 
falls short of accounting for it at z = 4.2 by a factor sw 4 
while simultaneously overestimating its value by a factor 
« 2 at z — 2 (panel B), in the best-fit case. Note that if 
we had assumed an abundance of Lyman- limit systems 
incre asing with redshift as (1 + z) 2 (as in iMadau et al.l 
1999, and appropriate for lower column density systems) 
instead of (1 + z) 1 - 5 , then the discrepancy at z = 4.2 
would be even larger. Unless the escape fraction of star- 
forming galaxies or the IMF evolve appropriately with 
redshift, our measurement of the total photoionization 
rate from the Lya fores t is therefore in co nflict with the 
best-fit SFR density of IHopkins fc Beacoml (J2006). We 
will discuss potential issues with this SFR estimate in fJOJ 

Note that in Figure [5] we have only shown quasar nor- 
malizations from 0.1 to 0.35, as for higher normaliza- 
tions quasars alone overproduce the measured total pho- 
toionization rate, which is of course unphysical. The fact 
that a normalization strictly less than unity is required 
may indicate that the photoionization rate derived from 
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Fig. 5. — Best-fit stellar (red dotted) and quasar+stellar (purple solid) contributi ons to the hydrogen p hotoionization rate for varying 
normalization of the quasar component calculated based on the luminosity function of Hopkins ct al. ( 2007) (blue long-dashed). The stellar 
ionizing emissivity is assumed to trace the star formation rate density in the theoretical model of Hernquist & Springel (2003) (panel A) or 
the best-fit to observational estimates of [Hopkins & Beacom (2006) (panel B). In each case, the best-fit stellar normalization is calculated 
for a fixed quasar normalization, from 0.1 to 0.35, modeling the effects of an escape fraction less than unity or of an uncertainty in the 
normalization of th e mean free path of ionizing photons. Because the stellar contribution peaks near z sa 2 similarly to quasars for the 
Hopkins & Beacom (2006) star formation history, the sum of the two fails to account for the flat photoionization rate measured from the 
Lycr forest over the redshift range 2 < z < 4.2. 

the forest is too low either because of an overestimate 
of the mean free path of ionizing photons or inexact 
spectral assumptions. A smaller mean free path would 
yield, for fixed emissivity, a lower photoionization rate 
(eq. I25|) . The ionizing emissivity, in turn, is obtained 
from modeling the quasar spectrum between the .B-band 
at ~ 4400 A and the Lyman edge at 912 A. The pho- 
toionization rate moreover depends on the spectral shape 
shortward of 912 A and therefore some level of uncer- 
tainty in the calculated value definitely arises from the 
assumed spectrum. 

It could also indicate that the escape fraction of Ly- 
man continuum photons from quasars is in fact less than 
unity. It is interesting to consider why this may be the 
case. Although (unlike GRBs occurring in star-forming 
galaxies) quasar hosts typically do not show DLAs, 
Lyman limit systems are observed to cluster around 
quas ars, apparently preferentially in the transverse direc- 
tion (iHennawi et al.l l2006t [ Henn awi fc Proch aska 2007; 
Prochaska & Hennawi 2008) . It is possible that such sys- 
tems absorb a significant fraction of the ionizing radia- 
tion emitted by the quasars they surround before these 
penetrate into the diffuse IGM, resulting into an "effec- 
tive" escape fraction less than unity. A similar effect may 
also be in action around star-forming galaxies, although 
Lyman limit systems may cluster more weakly around 
the latter owing to their lower typical masses. As our 
argument here is based on the shape of the evolution of 
the photoionization rate, it is largely robust to the nor- 
malization uncertainties. 

In any case, the apparent overproduction of the ion- 



izing background by quasars alone highlights the un- 
certainties in converting from a luminosity function to 
a photoionization rate. In particular, models that are 
based on integrati ng the luminosity functions of the ion- 
izing sources (e.g.. lHaardt fc Madaul ll996) risk being sig- 
nificantly in error in normalization (see E)7.5p . Calibrat- 
ing these models to the photoionization rate measured 
from the Lya forest using the flux decrement method, 
while itself subject to some systematic effects (32J), should 
yield more robust results. 

We now proceed to consider further constraints on 
the cosmic ultraviolet luminosity density imposed by the 
reionization of hydrogen and helium. 

5.4. Clumping Factor 

As recombinations result from two-particle collisions, 
their average rate is proportional to the clumping factor 
C = (n 2 )/(n) 2 of the gas. The clumping factor is there- 
fore a key quantity in calculating the ionization history 
of the Universe. We pause to discuss its numerical value. 

Many early calculations of the evolution of the global 
ioniz ed fraction during reionization (e.g., iMadau et al.l 
119991 ) assumed clumping factors derived from averaging 
over t he entire gas content of hig h- resolution simulations 
(e.g., iGnedin fc Ostrikeii Il997t iSpringel fc Hernquist] 
2003b), which were as large as ~ 30 at the redshifts ~ 10 
relevant for hydrogen reionization. Such clumping fac- 
tors are however unrealistically high, as they include gas 
in collapsed halos which are associated with the galaxies 
that produce the ionizing photons. As the escape frac- 
tion / esc already accounts for the effects of clumpy gas 
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tion of species i can be written as 

dx t 1 f 00 dv 

—— = — / — e„ - Ci4Tn e j:, 
at Ui ./„. hv 



(33) 



100 



Fig. 6. — Ulump n 

IMiralda-Escude et al.l (120001 ) gas density PDF, C = {A 2 )/(A> 2 , 
as a function of the maximum dimensionless overdensity A max 
included in the integration. The curves are for z =2, 4, and 
6 from most to least clumpy. The vertical dashed line shows 
the overdensity at the virial radius r2oo of isothermal halos, 
A(r2oo) = 200/3 ~ 67, relevant if the gas within collapsed halos is 
to be excluded. 



within these sources, the latter should not be included 
in calculating the clumping factor used to calculate the 
recombinations in the diffuse IGM. 

Let us identify the size of collapsed structures with 
their virial radius, with the latter approximated by the 
radius within which the mean density is 200 tim es the 
mean cosmic density (e.g.. lBarkana fc Loebll200JT ). Then 
if halos are further approximated as isothermal spheres, 
p(r) oc r~ 2 , their dimensionless overdensity A = p/(p) 
at the virial radius is given by A(r 2 oo) = 200/3 ~ 67. 
A crude estimate of the clumping factor excluding gas 
within the virial radii of halos is then obtained by cal- 
culati ng C = (A 2 ) /(A) 2 using the IMiralda-Escude et all 
(2000) PDF truncated at A max = A(r 20 o)- Figure © il- 
lustrates the result of this calculation at z = 2, 4, and 6 
for varying A max . As expected, the clumping factor de- 
creases with increasing redshift for fixed A max . 

For the redshifts z > 6 relevant for hydrogen reion- 
ization, C < 4 for A max = A(r 2 oo)- If Hell rcionization 
proceeds between at z ~ 3—4, then slightly higher clump- 
ing factors C ~ 7 are more appropriate. Of course, these 
estimates are rough and we will therefore present our 
calculations for a range of reasonable clumping factors. 

5.5. Constraints from the Reionization of Hydrogen and 

Helium 

The facts that hydrogen is reionized by z — 6 and 
helium is fully ionized by z rs 3 constrain the production 
of ionizing photons at earlier times. We investigate these 
constraints here. 

The rate of change of the mass-weighted ionized frac- 



where Ri is the recombination coefficient from the ionized 
to the ground state. Although many studies of reion- 
ization use the case-B recombination coefficient on the 
basis that recombinations directly to the ground state 
produce an ionizing photon and therefore have no net 
effect on the ionized fraction, most of the recombina- 
tions in a clumpy universe occur near dense regions 
(such as Lyman-limit systems), so that the reemitted 
photon is likely to be absorbed before it escapes into 
the diff use IGM l|Miralda-Escuddl2003t iFurlanetto fe~Ohl 
20071)). We therefore use case- A recombination coeffi- 
cients. 
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Fig. 7. — Evolution of the hydrogen ionized fraction. Star- 
forming galaxies are assumed to be the dominant sources of ion- 
izing photons, with emissivity at z = 3 normalized to the value 
inferred from the hydrogen photoionization rate T measured from 
the Lya forest. The redshift evolution of the emissivity is assumed 
to follo w the star formation rate density in the theoretical model of 
Hernquist & Springel (2003) (blue solid) or the fit to observational 
data points compiled by Hopkins & Beacom (2006) (red dashed). 
In each case, the clumping factor takes the values C = 0, 1, 5, and 
10 from right to left. The vertical line indicates redshift z = 6, at 
which time the Universe is known to be reionized from observation 
of high-redshift quasars. Even in the most optimistic case of no 
recombinations (C = 0), the Universe fails to be reionized by this 
redshift by a larg e factor if the emissivity tra ces the star formation 
rate density fit of Hopkins & Beacom (2006). 



5.5.1. Hydrogen Reionization 

We first consider the case of hydrogen reionization. We 
assume that helium is singly ionized to Hell simultane- 
ously (x = yu) with hydrogen, with both fully neutral at 
very high redshifts unaffected by reionization (z > 50). 
We assume that stars are solely responsible for reionizing 
hydrogen and that the emissivity evolves with redshift 
following the SFR density estimates (eq. [28]) . Beyond 
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z = 3 .9, the highest redshift at which IZaldarriaga et al.l 
(|2001h measured the IGM temperature, we take the tem- 
perature to be constant at 22,000 K. We normalize the 
value of the specific emissivity e v at the Lyman limit to 
be that inferred from T measured from the Lya forest 
at z = 3 using equation fl24]), e„ m (z = 3) = 9.4 x 10~ 50 
comoving erg s _1 Hz -1 cm" 3 . The corresponding es- 
cape fraction will be estimated by comparing with the 
1500 A luminosity density obtained by integrating over 
galaxies in JJ5.6I For this conversion, we have assumed 
a spectral index ani = —0.5 shortward of the Lyman 
limit for a high-redshift ionizing background J„ dom- 
inated by star-f orming galaxie s . Th e theoretical star- 
burst models of iKewlev et al.l (|2001h produce intrinsic 
spectra with approximately F v oc v~ x between v\n and 
^Hcii = 4^hi, covering the wavelength interval that con- 
tributes most significantly to I\ This spectrum is then 
hardened, a — > a — 1.5, by IGM filtering. 

The redshift evolution of the specific intensity is as- 
sumed to follow the SFR density. Under the assumption 
that it does not evolve with redshift, this approach is free 
of assumptions in the escape fraction of galaxies. We in- 
vestigate a wide range of clumping factors by successively 
setting (7 = 0, 1, 5, and 10 (c.f. 3Q|) . 

The res ults are shown in F igure [7] for the theoretical 
model of Hcrnaui st fc Springell (|2003l) and for t he ob - 
servational SFR history of iHopkins fc Beacoml ([2006) . 
Of particular note h ere is that the SFR density fit of 
IHopkins fc Beacon] (J2006I ) (under the assumption we 
have made that it traces the ionizing emissivity) fails 
to reionize hydrogen by z — 6 by a large factor even in 
the most optimistic case of no reco mbinations. This fur- 
ther supports the conclusion that the Ho pkins fc Beacoml 
(2006) SFR density estimates decline too steeply at high 
redshifts z > 3, which we had reached using only the 
measurement of the Lya opacity at z < 4.2. 

If the emissivi ty more closely follows the SFR den- 
sity predicted bv lHernquist fc Springe! ([2003), then the 
Universe is reionized by z = 6 provided that C ~ 1. 
This is lower than expected at z = 6 according to our 
simple estimate in £ 15.41 At higher redshifts more rep- 
resentative of the middle of reionization, however, the 
clumping factor is likely smaller. In addition, if low- 
density gas is reionized first, then an effective clumping 
factor C < 1 may result throughout most of reioniza- 
tion, because all the dense gas would remain locked up 
in self-shielded systems and should not be counted in 
the (A 2 ) term (iMiralda-Escude et alJl2000t l. Even the 
iHernquist fc Springell (|2003l ) model may be in tension 
with estimates of the redshift of reionization from the 
optical depth to Thomson scattering from the WMAP 
5-year data, which yiel d a sudden reionization redshift 
z reion = 11.0 ± 1.4 (jDunklev et~aTll2008D . This tension 
could be eased if baryonic mass were more efficiently con- 
verted into ionizing photons at very high redshifts, for 
example as a result of a top-heavy IMF. Alternatively, 
the gas consumption timescale could be shorter than the 
one fiducially assumed (£q = 2.1 Gyr), which would push 
the peak of star formation to a higher redshift. 

The conclusions of the present sectio n are in general 
agreem ent with the similar analysis of iMiralda-Escudl 
(2003), who found that the ionizing comoving emissivity 
cannot decline from z — 4 up to z ~ 9 by more than a 
factor 1.5 if reionization is to be complete at z = 6. Our 



results also support the picture of a "photon-starved" 
reioni zation similarly advocated by iBolton fc Haehnern 
(2007) based the z = 5 — 6 Lya forest photoionization 
rate. 




Fig. 8. — Evolution of the fraction of fully ionized helium. 
All the helium is assumed to be initially in the form of Hell and 
to be doubly ionized by the action of quasars. The quasar ioniz- 
ing emissivity i s calc ulated based on the B-band realization of the 
Hopkins et al. (2007) quasar bolometric luminosity function. The 
escape fraction of Hell ionizing photons that escape their quasar 
source, /cJ c ' ° , takes the values 1.0 (blue solid), 0.5 (green long 
dashed), and 0.1 (red short dashed). In each case, the clumping 
factor takes the values C = 0, 1, 5, and 10 from right to left. The 
vertical line indicates redshift z = 3, approximately the redshift at 
which observations of the Hell Lya forest provide evidence that 
Hell reionization is complete. Escape fractions of Hell ionizing 
photons from quasars significantly less than unity are excluded in 
this scenario. 



5.5.2. Helium Reionization 

We also consider the reionization of Hell to Helll, 
which we assume to proceed through the action of 
quasars only, requiring hard photons of energy > 54.4 
eV. In this case, we can rewrite the emissivity integral as 



dv 
hv 



fQSO 

J CSC 



Hell 



dL B N hB _c 



dL R 



where 



N, 



,HoII 



= 1.95 x 10 55 s _1 



L, 



10 12 L n 



(34) 



(35) 



is the number of Hell ionizing photons emitted per unit 
time by a quasar of i?-band luminosity Lb and dQ/dLs 
is again the i ? -band quasar luminosity function from 
IHopkins et al.1 (|2007l ). We again investigate the wide 
range of clumping factors C = 0, 1, 5, and 10. We 
examine escape fractions of Hell ionizing photons from 
quasars /~«f °> HcI1 = 0.1 and 0.5 in addition to unity. The 
results are shown in Figure [8] We find that quasars are 
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Fig. 9. — Fraction of the hydrogen total photoionization rate V contributed by quasars (1 — /*) as a function of the ratio of the mean free 
path of hydrogen ionizing photons to the mean free path of Hell ionizing photons. T he gray bands indica te the parameter space allowed 
by the measurement of the softness parameter of the UV background S = r/rjiell of [Bolton ct al. (2006) at z = 2.1, 2.4, and 2.8. The 
vertical long dashed lines show the ratio of the mean free paths estimated from the observed median column density ratio r\ = A^Hell/^Hl 
at each redshift. The vertical dotted lines indicate the range of plausible values for the ratio, defined as corre sponding to r\ = 10 and 
r] = 400, outside of which range measured values are probably not reliable (Rcimcrs et al. 2004; Shull et al. 2004). 

by IGM filtering, so that a§|° = agj 30 . Combining 
the above expressions, we can solve for the fraction of 
the total r contributed by quasars in term of the back- 
ground softness parameter S = T/Tn c u (where the Hell 
photoionization rate THeH is defined in analogy to the 
hydrogen rate T, but integrating only above the Hell 
photoelectric edge at 54.4 eV) and the ratio of the mean 
free paths: 



able to full ionize helium by z ~ 3, as required by obser- 
vations of the Hell forest, for escape fractions of unity. 
Escape fractions /^f ' I < 0.5 may however not be 
sufficient to fully reionize helium by this redshift unless 
the gas is unrealistically smoothly distributed (C w 1; 
but see comment in ij5.5.1l regarding the possibility of an 
effective clumping factor C < 1 during rcionization). 8 

An interesting consistency check on the contribution of 
quasars to the ionizing background is provided by mea- 
surements of the HI to Hell column density ratio of ab- 
sorbers, r\ = Nn e u/Nffl. Let us assume that the total 
hydrogen photoionization rate T is a sum of a stellar 
contribution and a quasar contribution, with a fraction 
/* coming from stars: 

r = r* + r QSO ; r* = /*r & r QSO = (1 - /*)r. (36) 

Further assume that only quasars contribute significantly 
to the Hell ionizing budget, so that rneii = Tj| eII . Again 



defining the helium terms in analogy to hydrogen, equa- 
tion (|24l) implies that 

pQSO 



ThcH 




.AZ^hcii)/' (3?) 

where the superscripts indicate that only the quasar com- 
ponent is considered. Defining the ratio of the mean 
free paths r = A^(fHi)/A/(^Hcii) arid for an unhardened 
emissivity e^ so oc i/ _a o»t«rf , this reduces to 
rQ so qso ,, 

= 4<Chard + l r) (38) 

ThcII 

where we have used <thi = 4tTHeii and i4j e ii = 4i/hi, and 
assumed that the UV background is uniformly hardened 

8 If the emergent quasar emission is beamed, then the true frac- 
tion of ionizing photons escaping into the IGM may be smaller. 
Since quasars beamed away from us would not be accounted for 
in the B-band luminosity function, this is ho wever the relevant 
effective escape fraction to use in equation 11311 . 



1 - /* = 



QSO 
4 a unhardr 



(39) 



As both r and S depend on 77, measurements of 
the latt er constrain 1 — /*. Using hydrodynamical simu- 
lations, [Boltoiiietlal] (|2006h infer the softness parameter 
S from 77 obtained by fitting spectra of the HI and Hell 
Lya forests of the qua sar HE 2347-4342 (|Zheng et all 
12004 IShull et al.ll2004T ). They find a softness parameter 
increasing from about S = 140 at z = 2.1 to about 
S = 300 at z = 2.8, with large uncertainties. In Figure 
02 we show the contribution of quasars to the hydrogen 
photoionization rate 1 — /* allowed by their measurement 
as a function of the ratio of the mean free paths r at 
z = 2.1, 2.4, and 2.8. 

What is a reasonable value for the ratio of the mean 
free paths? Opacity owing to hydrogen only constrains 
the mean free path at the Hell photoelectric edge to be 
less than 8 times the value at the hydrogen Lyman edge 
(eq. l22|) . Helium opacity is however the limiting factor 
for the the mean free path of Hell ionizing photons. A 
rough estimate of the Hell mean free path can be ob- 
tained by assuming a constant ratio of column densities 
77 = Nudi/Nni and making a Jacobian transformation 
to relate the column density of Hell to that of HI: 



d 2 N{N KelI ) _ 1 d 2 N(N m = JVaeii/r) 



dN HelI dz 



dN m dz 



(40) 



Equation (|2"2"]) may then be applied to express the Hell 
mean free path in terms of its column density distribution 
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by simply making the replacement HI— >HeII. 9 Taking the 
ratio to the mean free path at the Lyman edge owing to 
hydrogen opacity, we find 



1-/3 



(41) 



For the median colum n density ratios 77 = (47, 68, 106) 
at z = (2.1, 2.4, 2.8) (| Zheng et all 12004 Bolton et all 
2006) and approximating (5 = 1.5, we find r = 
(3.4, 4.2, 5.2). These ratios are plotted as vertical 
dashed lines in Figure [9] and suggest that quasars con- 
tribute a large (perhaps most) of the hydrogen ionizing 
background at z = 2.1, near the peak of the quasar lumi- 
nosity function, with their contribution fractionally de- 
creasing with increasing redshift. 

We need to point out some uncertainties in this sim- 
ple calculation. There are three main sources. First, 
in assuming a constant 77 equal to the observed median, 
we have neglected the large fluctuations that are seen. 
A rough estimate of the uncertainty in the ratio of the 
mean free paths induced by the large fluctuations is ob- 
tained by considering the extreme ratios 77 = 10 and 
77 — 400, outside of which range the measured values 
are probably not reliable owing to difficulties introduced 
by background subtraction, the low signal-to-noise ratio 
of the spectra, line saturation, and blending of higher or- 
der Lyman serie s lines and metals ()Reimers et al J 120041 : 
IShull et aT1l2004f L These cases are indicated by the ver- 
tical dotted lines in Figure [9] Consiste ntly, we have 
also u sed the softness parameter inferred bv Bolton et al.l 
( 2006) for a spatially uniform UV background, which will 
be in error if the column density fluctuations arise from 
a fluctuating radiation field. 

Second, the vast majority of the absorbers for which 
the column density ratio 77 has been measured are opti- 
cally thin to both HI and Hell ionizing photons, whereas 
the systems that are optically thick to Hell ionizing pho- 
tons are likely to contribute significantly to limiting their 
mean free path. As the expected column density ratio 77 
varies non-monotonically with increasing column density 
ratio A^hi near the optically th ick transition for reason - 
able background spectra (e.g.. lHaardt fc Madaul Il996[) . 
it is unclear in which direction our optically thin calcu- 
lation for the mean free path ratio may be biased. 

Finally, we have neg lected a possible ant i -correlation 
betw een 77 and Am (Rei mers et al.l 120041 : IShull et"aLl 
2004) . This anti-correlation would tend to make our cal- 
culation of the Hell ionizing mean free path an overes- 
timate, so that r would be underestimated. In light of 
these uncertainties, the exact numerical values in Fig- 
ure [HI should be interpreted with caution. Nevertheless, 
the extreme cases indicated by the dotted lines and the 
steep increase of the quasar contribution 1 — /* for r > 1 
convincingly argue that at their z ~ 2 peak, quasars con- 
tribute a non-negligible fraction (> 20%) of the hydrogen 
ionizing background, and possibly even dominate it. 

A caveat to the above arguments is that it is not in- 
conceivable that galaxies contri bute a non-negligible frac - 
tion of Hell ionizing photons (jFurlanetto fc Ob|[2007bD . 

9 This approach neglects the contribution of hydrogen opacity 
to the Hell mean free path. The latter is however negligible com- 
parable to the Hell opacity for the measured column density ratios 
V- 



For example, the c omposite z ~ 3 LBG spectrum of 
IShaplev et al.l (|2003l ) shows a significant Hell A 1640 re- 
combination line but no evidence for AGN contamina- 
tion. In some scenarios, this Balmer-a line may be ac- 
companied by Hell ionizing photons. Associating the 
production of Hell ionizi ng photons with star formation, 
iFurlanetto k, Obi (|2007b[ ) show that a large escape frac- 
tion > 50% for such photons is however required for 
LBGs to contribute comparably to quasars to the in- 
tergalactic Hell ionizing flux at z ~ 3. Although we 
cannot rule this out, the speculative nature of stars as 
a source of Hell ionizing photons and the large escape 
fraction that it would require motivate us to at present 
take the conservative view that this scenario is unlikely 
Moreover, a significant contribution to UV emission at 
the Hell photo electric edge from ho t gas in galaxies and 
galaxy groups (|Miniati et al.l [20041 ) would decrease the 
expected fluctuations in the HI to Hell column density 
ratio, which appears difficult to reconcile with the large 
increase in th e Hell opacity fluctuations toward z > 3 
(jBolton et al.ll2006l ). 



5.6. Direct Comparison with Galaxy UV Luminosity 
Functions and the Escape Fraction of Ionizing 
Photons 

The arguments of this section have thus far funda- 
mentally relied on the shape of the redshift evolution 
of the quasar emissivity and of the total photoionization 
rate. This is the reason we used analytic fits (which can 
be straightforwardly extrapolated to higher redshifts) to 
the star formation history, a quantity which at high red- 
shifts is derived from the observed UV luminosity func- 
tions. As the UV luminosity functions themselves are 
the relevant quantities that involve the least unnecessary 
assumptions, it is of interest to compare them directly 
with the UV emissivity implied by our Lya forest mea- 
surement by equation (|26|) . 

To estimate the contribution of star-forming galaxies 
to the UV background, we consider recent determina- 
tions of the galaxy UV luminosity function from Lyman 
break (LBG) surveys at z > 2 by | Sawicki feJ Thompsou 
(2006) (Keck Deep Fields). iBouwens et al.l (|2007) (Hub- 
ble Ultra Deep Field [HUDF] and other deep Hubble 
Spa ce Telescope [ HST] deep fields). ISteidel et alj dl99l) 
andlReddv et al.l (|2008f) (Keck LBG). and lYoshida et all 
(2006) (Subaru Deep Field). These were selected to 
be the most up-to-date measurements in the fields cov- 
ered. The measured luminosity functions are summa- 
rize d in Table J21 where in each case the parameters of 
the ISchechterl (|1976h function are defined by 



oaulL = * [±YeKp(-±)d(±; 



(42) 



and the break magnitude M* is related to the character- 
istic luminosity L* by the usual AB-magnitude conver- 
sion: 

L* = 4tt(10 pc/cm) 2 10- a4 ( M * +48 - 60 > erg s" 1 (43) 

(|Oke fc Gunn| [l983). Although the exact effective wave- 
length depends on the selection of the particular sample 
of interest, we will assume in our calculations that the 
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TABLE 3 
Galaxy UV Luminosity Functions 



2 


M* 


<t>* 

10 3 com Mpc 3 


a 


Survey 


Area 


Reference 


2.3 a 

3.05 a ' b 

4.0 C 


-20.97 ±0.23 

-20.84 ±0.12 

-20.84 


1.74 ±0.63 
1.66 ± 0.63 
1.64 ±0.15 


-1.84 ±0.11 
-1.57 ±0.22 

-1.57 


Keck LBG 


4 deg 2 


Reddv et al. (2008) 
Stcidel et al. (1999) 


1.7 

2.2 
3.0 
4.0 


-19.80 ±0.29 
-20.60 ±0.41 
-20.90 ±0.18 
-21.00 ±0.43 


17.0 ±4.3 
3.02 ±1.79 
1.70 ± 0.42 
0.85 ±0.65 


-0.81 ±0.18 
-1.20 ±0.23 
-1.43 ±0.13 
-1.26 ±0.38 


Keck DF 


169 arcmin 2 


Sawicki & Thompson (2006) 


3.8 
5.0 
5.9 


-20.98 ±0.10 
-20.64 ±0.13 
-20.24 ±0.19 


1.3 ±0.2 
1.0 ±0.3 

1.4 ±0.5 


-1.73 ±0.05 
-1.66 ±0.09 
-1.74 ±0.16 


Hubble UDF 

and other deep 

HST fields 


44 arcmin 211 


Bouwens et al. (20071 


4.0 
4.7 


-21.14 ±0.15 
-20.72 ±0.15 


1.46 ±0.38 
1.23 ±0.36 


-1.82 ±0.09 
-1.82° 


Subaru DF 


875 arcmin 2 


Yoshida et al. (2006) 



Note. — Where the error is not explicitly given, the parameter was held fixed in the fit. 
a Central redshift of the sample. b Includes space-based Hubble Deep Field data. c Fit to the Stcidel et al. (1999) LBG data 
converted to ACDM cosmology. The M* and a parameters were fixed to the z ~ 3 determination of the luminosity function 
of I Reddv et al.l 1120081) (Naveen Reddy 2008, private communication). 11 Excluding the shallower GOODS fields also included in 
their analysis, but including the "Parallel" deep fields. 



UV luminosity functions are valid at 1500 A and label 
the corresponding frequency by v\jy- 

For a UV luminosity function given in comoving units 
the corresponding comoving UV emissivity is simply ob- 
tained by taking the first moment of the luminosity func- 
tion, 



com 
e UV 



dLL^(L) = L*ct>*T{a + 2, L min /L+), (44) 



where only sources above the minimum luminosity L m i n 
are accounted for and T(a + 2, L m i n / L±) is the upper 
incomplete gamma-function. 

Figure \W\ shows the completeness fraction T(a + 
2, x)/T{a + 2) as a function of the faint-end slope a 
and the fraction of L* down to which the luminosity 
function is integrated, x = L min /L+. For steep faint- 
end slopes a ~ —1.8 and surveys probing to 0.1L*, only 
about one third of the UV emissivity is actually directly 
observed. The extrapolation to the entire luminosity 
function (£ m i n = 0) thus generally involves a substan- 
tial factor. It should therefore be borne in mind that a 
non-negligible error could be made if the faint-end slope 
is not well constrained, or changes below the present ob- 
servational limits. 

In Figure QTJ we show the UV emissivity from LBGs 
calculated by integrating the luminosity functions to 
imin = and the same quantity derived from our 
Lya forest measurement. The error bars we quote on 
the emissivities calculated from the luminosity functions 
are propagated from those on the individual Schcchtcr 
parameters; because the latter are generally correlated, 
these will overestimate the true e rrors on the luminos- 
ity de nsities. Exceptions are the ISawicki fc Thompson! 
(2006) points, for which we take the total luminosity 
densities and errors reported by the authors. As the 
photoionization rate T is the quantity that is directly 
measured from the Lya forest, the normalization of the 
forest UV emissivity depends on the a priori unknown 
ratio (l// esc )(1500 A/912 A) Quv (a ffl +3) (eqs. [Hand 
26|) . We find the normalization minimizing the x 2 with 
respect to the UV emissivities calculated from the lu- 
minosity functions. To do so, we consider only the data 
points overlapping with our measurement (1.9 < z < 4.3) 
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Fig. 10. — Completeness of the emissivity as a function of 
the fraction of the characteristic luminosity L* down to which 
the luminosity function is integrated. The different curves cor- 
respond to increasingly steep faint-end slopes from right to left: 
a = -1.1, - 1.2, - 1.3, - 1.4, - 1.5, - 1.6, - 1.7, - 1.8, 
and -1.9. Slopes between -1.6 and -1.8 are typically measured (c.f. 
Table [3j and are indicated by thicker curves. 

and compare them with the nearest Az = 0.2 bin. To 
avoid giving all the weight to a particular set of mea- 
surements, we artificially increase the error bars in this 
procedure. The error bars on the emissivity implied by 
the Lya forest are artificially increased in the x 2 mini- 
mization to avoid giving unjustified weight to emissivities 
calculated from UV luminosity functions with unrealis- 
tically small error bars. 

Solving for / csc requires knowing auv and am ■ We al- 
ready discussed our choice of a„ HI = —0.5 in < T5 . 5 . 1 1 Rest- 
frame UV spectra of LBGs at z ~ 3 (e.g., IShaplev et al.l 
2003) are observed to be close to flat from 1500 A to 
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Fig. 11. — Comoving UV specific emissivity at 1500 A obtained 
by integrating galaxy UV luminosity functions. The green points 
are from Sawicki & Thompson (2006) (Keck Deep Fields), the cyan 
points from Rcddy et al. (2008) (Keck LBG), the red points from 
Yoshida et al. (2006) (Subaru Deep Field), and the magenta points 
from Bouwcns et al. (2007) (Hubble Ultra Deep Field and other 
deep HST fields). The blu e point co rresponds to the luminosity 
function estimated from the Stcidel et al. (1999) z ~ 4 LBGs, with 
the chara cteristic mag n itude and faint-end slope set to the z ~ 3 
values of [Reddy et al. (20080 (Naveen Reddy 2008, private com- 
munication). See the text for caveats about the error bars shown. 
The black points show the emissivity implied by our Lya forest 
measurement, where the normalization has been set to match the 
luminosity function derived values. The error bars on the emis- 
sivity implied by the Lya forest were artificially increased in the 
X 2 minimization to avoid giving unjustified weight to emissivities 
calculated from UV luminosity functions with unrcalistically small 
error bars. The error bars account only for the statistical uncer- 
tainty on our derived T measurement only. 

Lya (1216 A). Although the Lya forest suppresses the 
transmitted flux shortward of Lya, there is little evidence 
for a change in the intrinsic galactic spectral shape down 
to the Lyman limit at 912 A. We thus take arjv = 0. 
Longward of the Lyman limit, the spectrum is not hard- 
ened by IGM filtering like ionizing photons. Therefore, 
the spectral index of the UV background should be well- 
approximated by the spectral index of its sources. Note 
that we are here assuming that T is dominated by stel- 
lar emission over the entire redshift range probed by our 
Lya forest measurement. If quasars contribute a large 
fraction at z ~ 2, as suggested by the hardness of the ion- 
izing background inferred from Hell column densities in 
S J5.5.21 our estimate of the escape fraction will be biased 
high since a lower fraction of the ionizing photons would 
need to be accounted for by galaxies. As the ionizing 
background can confidently be assumed to be dominated 
by stellar emission beyond z > 3 ( §5.3|) . our estimate 
should not be off by more than a factor of two because 
of this assumption. 

The best-fit value for f csc is 0.5% for these values of 
quv and am- Is this seemingly low value reasonable? 

We need to pause and clarify our definition of / esc , 



as a number of variations are present in the literature. 
Our definition as the number which satisfies equation 
(|2l)|) measures the discontinuity of the emergent galactic 
spectrum at the Lyman limit. Provided any « 0, as we 
have assumed, this definitio n is very clo se to the obser- 
vational definition of Stcide iet al.l (|2001l ) as the ratio of 
the emergent specific flux from LBGs at 900 A to that 
at 1500 A, /[900]//[1500]. This differs from the frac- 
tion of ionizing photons emitted by a galaxy that escape 
unabsorbed into the IGM owing to at least two effects. 

First, a large fraction of UV photons at 1500 A also 
do not escape the galaxy in which they are produced ow- 
ing to absorption by dust. This is the same effect that 
requires us to correct for dust absorption in estimating 
the rate of star formation from the observed UV lumi- 
nosity functions (see 36. II). For the " common" UV ob- 
scuration correction of lHopkini (|2004D at high redshifts, 
about 29% of the intrinsic 1500 A UV flux escapes its 
galaxy, but other estimates suggest that as little as 15- 
20% may escape from z ~ 3 LBGs (jPettini et all 119981 : 
lAdelberger fc S tcidel 2000). This effect thus causes our 
/ csc to overestimate the true fraction of escaping photons 
by a factor ~ 5. 

Second, even in the absence of intergalactic absorption 
or absorption from the host galaxy, the intrinsic spec- 
trum of the stellar population is likely to exhibit a break 
at the Lyman limit owing to the presence of hydrogen 
in the envelopes of the stars themselves. If this is the 
case, then our / csc , which quantifies the magnitude of the 
Lyman-limit break, will underestimate the true fraction 
of ionizing photons that escape their galaxy by the same 
factor as the intrinsic stellar break. The observational 
constraints on this intrinsic stellar break are essentially 
non-existent, as the effect is degenerate with galactic 
self-absorption and observations shortward of the Lyman 
limit are very challeng ing owing to the small amount of 
trans mitted flux (e.g.. ISteidel et al1l2001t IShaplev et al.1 
2006). Theoretical calculations based on stellar popula- 
tion synthesis however predict that the stellar Lyman- 
limit break can be a factor of ~ 3 to ~ 5.5 over a 
plausible range of ages a nd IMF (jLeitherer et al J fl999t 
iBruzual &; Charlotl I2003D . This tends to counteract the 
overestimate caused by UV dust absorption, although 
the two effects are unlikely to perfectly cancel each other 
and a factor of ~ 2 difference between our / esc and the 
true faction of escaping ionizing photons is possible. 

From a compos it e sp ectrum of 29 z ~ 3 
LBGs, ISteidel et al.l (|200l[ ) estimated a large / osc « 
/[900]//[1500] « 20%. However, as they note, the 
galaxies stacked in their composite spectrum were drawn 
from the bluest quartile of the LBG population and 
it is unclear whether the escape fraction of these ob - 
jects is representative of all LBGs. IShaplev et al.l (|2006l ) 
more recently obtained deep rest-frame spectroscopic Ly- 
man continuum observations of 14 z ~ 3 star-forming 
galaxies. These authors detected escaping ionizing ra- 
diation from 2 individual objects in their sample, with 
the remaining 12 showing no evidence of Lyman contin- 
uum flux. Averaging over their entire sample, they find 
an escape fraction ~ 4.5 times lower than inferred by 
ISteidel et al.l (J2001), / csc ~ 0.05. By measuring the inci- 
dence of absorbers optically thick at the Lyman limit in 
the spectra of 28 long-duration gamma-ray burst after- 
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glows at z > 2, 1 Chen et all (|2007f ) estimate the escape 
fraction at 0.02 ±0.02, with a 95% confidence level upper 
limit of 0.075. Note that this latter escape fraction ac- 
tually refers to the fraction of Lyman-limit photons that 
escape the host galaxy. 

Another important point is that the escape fraction 
as measured from direct spectroscopic observations is in- 
evitably representative of the bright-end of the galaxy 
population, since these observations are impossible on 
the faintest galaxies. If the i ncidence of long-duration 
GRBs traces the SFR (e.g., iFvnbo et all [2008), the 
GRB-DLA method will instead yield an escape fraction 
weighted by star formation, a large fraction of which oc- 
curs in fainter objects. Even if this is not strictly the 
case, most GRBs appear to be hosted by relatively typ- 
ical galaxies, the m ajority having relativel y small mass 
and low luminosi ty (Wainwright et al. 20 Q3JCIiarv et all 
120071 lLapi et al.ll2008t iSavaglio et alJl2008T) . Similarly, 
our method (solving for the value in eq. [25] that brings 
the photoionization rate measured from the Lya forest 
in agreement with UV galaxy luminosity functions) will 
yield an escape fraction that is weighted by emis sivity. 
The numerical simulations of iGnedin et al.1 (|2007h sug- 
gest that the escaping ionizing photons originate from 
a small fraction of lines of sight essentially free of in- 
terstellar medium, as opposed to a nearly homogeneous 
semi-opaque medium. If this is the case, then the es- 
cape fraction may well increase with the amount of galac- 
tic mechanical feedb a ck, e.g. from supe rnova explosions 
(|Clarke fc Oeyll2002t iFuiita et al.ll2003l ). Galaxies that 
are more luminous in the UV and therefore sustaining a 
higher SFR may thus have escape fractions higher than 
average. 

Especially considering the discrepancy that could arise 
from the different definitions of the escape fraction, our 
small value is consi stent (albeit on th e low end) with 
the one derived by IChen et all (|2007l ) from the GRB 
DLA distribution. It is, how ever, significa n tly sm aller 
than the values obt ained by iSteidel et al.l (|2001l ) and 
Shapl e~v~et alj (|2006f ). By the remarks of the previous 
paragraph, the results could be reconciled if the es- 
cape fraction increases with galactic luminosity, with di- 
rect observations probing more luminous objects and our 
method a nd the GRB-DLA m etho d probing fainter ones . 
Although ISteidelet all (|2Q0U > and lShaplev et all (|20Q6h 
predicted an ionizing background in reasonable agree- 
ment with values derived from the Lya forest for their 
high escape fractions, these authors used values for the 
mean free path of ionizing photons at z — 3 and an ion- 
izing background spectral index am different from ours 
and only considered the emission from galaxies with UV 
luminosity above 0.1L*, whereas we integrated the lumi- 
nosity functions all the way to zero. Each of these factors 
conspires to skew the calculation of the predicted T in the 
same direction. We have verified tha t our calculations are 
nu merically consis t ent w ith those of lSteidel et al.l (|2001h 
and lShaplev et all (|2006h when the same mean free path, 
spectral indexes, and completeness are assumed. The 
scaling of our derived escape fraction with these param- 



eters is 



/esc = 0.5% 



Al(v m , z = 3))\ /a H i + 3 



85 proper Mpc / \ 2.5 



/912A\ Quv /r(a + 2, L min /L*)^ ' 



V 1500 A 



T(a + 2) 



(45) 



Finally, it is interesting to note that this high-redshift 
estimate is in reasonable agreement even with estimates 
of the escape fraction from the z = Milky Wa y 
(|Bland-Hawthorn fe Malonevll999HPutmaii et alj2003j) . 
A related question is whether this escape fraction is dif- 
ferent for the earliest galaxies that are responsible for 
rcionizing the Universe. 

Within the large scatter, the redshift evolution of UV 
emissivity derived from the Lya forest is reasonably re- 
produced by the emission from LBGs only. The only hint 
of a decline of the galaxy UV emiss ivity near z = 4 comes 
from t he highest-redshift point of ISawicki fc Thompson! 
(2006). This measurement is inconsi stent with the higher 
poi nts from the Subaru Deep Field (|Yoshida et al.|[2006T) 
and ISteidel et al.1 p999). This may owe to cosmic vari- 
ance in the relatively small Keck Deep Fields (KDF; 169 
arcmin 2 vs. ~850 arcmin 2 for Subaru and Steidel et al.), 
though in principle this should be mitigated by the three 
spatially independent fields of the KDF. Quasars being 
clearly insufficient to solely account for the entire ionizing 
background implies that galaxies almost certainly domi- 
nate at z > 3. Albeit with significant uncertainties, the 
fact that the total UV emissivity derived from the forest 
evolves similarly to the emissivity of LBGs suggests that 
the latter may in fact dominate the ionizing background 
at all redshifts 2 < z < 4.2 probed here. The ratio of 
Hell to HI absorption however constrains the hardness 
of the UV background and limits the e xtent to which 
galaxies can dominate ov er quasars fe.g.. lHaehnelt et al.l 
I200H: IBolton"lt~aIll200l . 

6. THE MADAU DIAGRAM REVISITED 

Our results thus far have suggested tension between 
the state-of-the-art determinations of the instantaneous 
SFR density versus redshift (often known as the "Madau 
diagram"; Lilly et al . 1996, Madau et al . 1996 ), as rep- 
resented by the fit of lHopkins fc Beacoml (|2006f) . and the 
cosmic UV luminosity density implied by the Lya forest. 
In order to better understand the source of this discrep- 
ancy, we use recent UV luminosity functions to recon- 
struct the Madau diagram at z > 2 in a manner similar 
to previous work. We then contrast this with what we 
obtain by deriving the diagram from the UV emissivity 
implied by our measurement of the Lya forest opacity. 
The steps in this process are: 1) calculate the UV emis- 
sivity (either from from luminosity functions accounting 
for incompleteness, or from the Lya forest), 2) correct for 
dust extinction, and 3) convert from dust-corrected UV 
emissivity to SFR dens ity. These steps a re pa rticularly 
clearly summarized by iSomerville et al.l (|2001l ) in their 
appendix. We have already carried out the first step in 
the previous section (Figure [TTj) . 



6.1. Dust Corrections 
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The quantity that is directly related to the SFR is the 
total number of UV photons produced by massive, short- 
lived stars. A large fraction of these photons are de- 
stroyed by dust before they escape their host galaxy, so 
that the observed UV luminosity function must be cor- 
rected for dust obscuration before a SFR density can be 
inferred. These corrections are very important, as they 
can be a factor of several. 

Unfortunately, we do not presently have an accu- 
rate handle on the dust corrections, whi ch are likely to 
be at least lum inosity- dependent ([H opkins ct al. 
20031 ISullivan et all r2001b iPerez-Gonzalez et al.1 



2001 



2003; 



Afonso et all [2003: Rcd dv et all 2006). Moreover, these 



should to some extent evolve with cosmic time as dust 
is produced and destroyed. Here, we will make the sim- 
plest assumption that the UV attenuation factor is inde- 
pendent of both cosmic time and luminosity at the red- 
shifts z > 2 we are concerned with. Specificall y, we will 
follow the "common" o bscuration corr e ction of [Hopkins 
(|2004D . who assume the iCalzetti et al.l ([2000D reddening 
curve resulting in an effective cons tant UV attenuation 
of a factor of 3.4. For comparison, ISteidel et al.l (J1999D 
applied a co rrection factor of 4.7 at z ~ 3 and z ~ 4 
based on the ICalzettil (|1997f ) reddening curve with typi- 
cal E{B -V)= 0.15. 

Although this assumption is certain to be inexact, it 
has the advantage of being consistent with our analysis of 
H5.31 where we investigated the cases of the ionizing emis- 
sivity tracing different SFR density evolutions. It is also 
the sa me correction as applied by iHopkins fe Beacoml 
( 2006) at high redshifts (z > 3) and therefore allows for a 
consistent comparison with the fit to the star formation 
history of these authors. Moreover, the observational 
evidence for strong evolution of the high-redshift UV 
attenuation remains marginal and it is unclear whether 
a more sophisticat ed model is warran ted at the present 
time. For instance. lOuchi et al.l (|2004h find no evolution 
in dust extinction (based on E(B-V)) between LBGs at 
z = 3 and 4. The UV dust att enuation factor ~ 1.5 
derived by iBouwens et al.1 (|2007h from the blue-slope 
0— values for z ~ 6 i— dropouts (jStanway et al.1 120051 : 
Yan et al. 2005, 2006) and the infrared excess-/? relation- 
ship ([Meurer et al.lll999h however suggests that the dust 
correction does eventually diminish with increase red- 
shift. 

In view of the clear uncertainties inherent in the dust 
corrections, we emphasize that our (and in fact all UV- 
derived) SFR density estimates should be interpreted 
with caution. Our philosophy in this work is to explore 
the implications of the simplest assumptions which ap- 
pear consistent with the existing evidence. 

6.2. From UV Luminosity to Star Formation Rate 

The basic conversion from specific UV luminosity in erg 
s _1 Hz -1 to SFR in M Q yr" 1 , which also directly con- 
verts from comoving s pecific UV emissivi ty to comoving 
SFR density, is that of lKennicutt] (jl998af k 



P* 



1.4 x 10 



~28^com 
e UV I 



(46) 



where p* is in units of comoving M Q yr Mpc pro- 
vided e™™ is expressed in erg s -1 Hz" 1 Mpc ~ 3 . This 
conversion is appropriate for a Salpcter ( 1955) IMF be- 
tween 0.1 and 100 M Q and a constant SFR of > 100 
Myr is assumed. In order to consistently compare with 



the IHopkins fe Beacoml ([2006D SFR density fit for a 
modified Salpeter A IMF w ith a turnover below 1 M© 
(Bald rv fc Glazebrookl [20031 . we multiply the star for- 
mation rate by a further factor of 0.77. 
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Fi g. 12. — Comovin g star formation rate density obtained with 
the IKennicutt] fll998aT ) conversion from UV luminosity to SFR, 
modified for a Salpeter IM F with a turno ver below 1 Mq (the 
modified Salpeter A IMF of IBaldrv fc Glaz cbrook 2003S). A con- 
stant dust obscuration correction factor of 3.4 has been applied 
at all redshifts following the high-redshift "common" correction of 
Hopkins (2004). Same co lor scheme as in F igure 1111 The dashed 
curve shows the best fit of Hopkins & Bcacom (2006) to star forma- 
tion history derived from their compilation of luminosity functions 
for a consistent IMF. 



6.3. Star Formation Rate Results 

In Figure [T^J we show both the SFR density derived 
from galaxy UV luminosity functions and from the UV 
emissivity derived from our Lya forest opacity measure- 
ment, assuming the best- fit escape fraction of JJ5.6I We 
find no compelling evidence for a decline in the comov- 
ing SFR density over the redshift range probed by our 
measurement, either from it or from the directly mea- 
sured UV_Juimno^itY_JunctJon, in contrast to the best 
fit of Hop kins fc Beacom (2006). Although the star for- 
mation rate derived from the Lya forest is subject to a 
significant uncertainty on the mean free path of ionizing 
photons, our assumption for the redshift evolution of the 
latter is conservative and the discrepancy would be ex- 
acerbated if Lyman limit systems instead evolved more 
similarly to optically thin systems f H4.2p . 

Inspection of Figure [12] suggests that the present data 
are instead roughly consistent with a constant p\ ~ 0.2 
M Q yr -1 Mpc -3 at 2 < z < 4.5. Since our analysis 
assumes a dust correction consistent with these authors 
at high redshifts, but is based on more recent data, it thus 
seems that (in combination with the arguments given 
in H5.3I and 15.5. ip the SFR density peak suggested by 
their fit is an artifact of the scarce high-redshift data 
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in their compilation, which may be affected by cosmic 
variance and is not uniformly com plete. For example, 
one of the z ~ 6 points that drive the[H opkins & B eacoml 
(2006) fit is the estimate of iBunker et all (|2004j ). which 
is only complete to 0.1L* and is based on an extremely 
small HUDF 1 1 arcmin 2 exposure. We instead consider 
the analysis of iBouwens et al] (|2007t ), which includes the 
HUDF data as a subset and yields a higher SFR density 
and consistently integrate the luminosity functions down 
to zero luminosity. 

The theoretical star formation history of 
IHernquist fc Springe! (|2003h . peaking between z = 5 
and z — 6, appears to trace the observational points 
better up to z w 5, though it may overestimate higher 
redshift points. Recall, however, from ^5.5.11 that the 
ionizing emissivity cannot decline much faster at high 
redshi fts than predicted by the IHernquist &: Springell 
(2003) model in order for the Universe to be reionized 
by z — 6. If intrinsically faint galaxies are increasingly 
dominant at high redshift, then it is possible than even 
the current deepest surveys are missing a significant 
fraction of the star formation rate density toward z > 5. 
We will return to this point in §7.31 

Note that, as in HbM we have again assumed that the 
hydrogen ionizing background is dominated by galaxies 
over the redshift range probed by our Lya forest mea- 
surement. If quasars contribute significantly at z ~ 2 
(as suggested by Hell column densities; H5.5.2[) . the 
predicted star formation rate from the Lya forest in 
Figure [12] should be lowered at these redshifts. As 
stars must dominate beyond z > 3 ft j5.3[) . our remarks 
regarding star formation are unaffected at these red- 
shifts. In Figure fT2l we have also renormalized the 
IHernquist fc Springe! (|2003f ) curve by a factor of three 
to match the observational points. Whereas the nor- 
malization of the observational points are subject to as- 
sumptions about the stellar IMF and dust corrections, 
the theoretical model is free of such assumptions and 
the two may therefore appear offset. Moreover, a dis- 
crepancy of this magnitude also exists between the ob- 
servationally measured stellar mass density versus red- 
shift and the time integral of the star form ation rate 
([Hopkins fc BeacoirJl200a IWilkins et al.ll2008t ). suggest- 
ing that at least one of them is incorrectly normalized. 

It is immediately clear from the scatter in Figures QT] 
and [12] that the total UV luminosity density extrapo- 
lated from the measured luminosity functions should be 
interpreted with caution. In fact, the dispersion between 
different points at fixed redshift is generally larger than 
the calculated error bars, indicating that these are un- 
likely to be uniformly reliable, a situation which is partic- 
ularly manifest at z ~ 4. There are several reasons why 
this may be the case. First, in all cases, the estimated 
luminosity density relies on an extrapolation to fainter 
magnitudes than probed by individual surveys. Second, 
cosmic variance arising from large-scale structure is dif- 
ficult to accurately quantify and may not be properly 
accounted for in all the measurements reported. Finally, 
some parameters are (perhaps inacc urately) held fixed in 
some fits. For instance, the z ~ 4 ISteidel et al.l (|1999f ) 
LBG point assumes that the characteristi c magnitude 
and fa int-end slope measured at z ~ 3 by iReddv et al.l 
(2008); only the density parameter </>* is fitted for in this 
case. Until these discrepancies are resolved, it appears 



dangerous to attempt a detailed fit of the z > 2 SFR 
history. 

7. DISCUSSION 

7.1. Reemission 

In addition to the Lyman-continuum photons directly 
emitted by quasars and galaxies, the IGM itself acts as 
a sou rce through recombinations fe.g. jHaardt k. Madaul 
1996). In the clumpy IGM, most of the ionizing photons 
are absorbed in Lyman-limit systems. Most likely, the 
atom that is ionized will be hydrogen. The free electron 
will then thermalize to a temperature ~ 10 4 K with the 
local gas. 10 Because the thermal kinetic energy of the 
electron is much smaller than the hydrogen ionization 
potential 13.6 eV« 1.6 x 10 5 K, even if the electron re- 
combines directly to the ground state and releases an ion- 
izing photon, the latter will have energy barely above the 
Lyman limit. Background photons with initially high en- 
ergy will thus penetrate deep into a Lyman-limit system, 
while the lower-energy remitted ionizing photons will re- 
main trapped. Thus, only background photons with en- 
ergy just above the Lyman limit will be absorbed on the 
skin of the Lyman-limit system and have a significant 
probability that a reemitted Ly man-continuum photon 
escapes the Lyman-limit system. IMiralda-Escudel (2003) 
estimates the increase of Lyman-limit emissivity owing 
to his effect to be <10%. The effect of recombinations to 
Hell is most important prior to Hell reionization, when 
even the diffuse IGM i s optically thick to He ll ionizing 
photons, in which case IMiralda-Escudel (j2003t ) estimates 
the effect at <4%. Therefore, reemission is likely to affect 
the hydrogen ionizing emissivity at only the < 10 — 15% 
level. Since this is relatively small compared to the other 
uncertainties we are dealing with, we neglect this in our 
considerations. 

7.2. The Gamma-Ray Burst Rate 

It is interesting to consider the gamma-ray burst rate 
under the assumption that it follows star formation. In 
Figure[l3l we plot the predicted rate per unit redshift per 
unit steradian in arbitrary units 11 under this assumption, 



dN, 
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(47) 



where d(z) is th e comoving distance to redshift 

for both the_ IHernquist fc Springell (|2003f ) and 



iHopkins fc Beacoml (|2006[) SFRs shown in Figure IT21 
Analyzing a sample of 36 lu minous Swift GRBs with red- 
shift in the range z = — 4. lKistler et all (]2008h conclude 
that ~ 4 more GRBs are observed at z ~ 4 than ex- 
pected if the GRB rate follows the IHopkins fc Beacoml 
( 2006 ) SFR. Interest i ngly as the Figure shows, the 
IHernquist fc Springell (J2003D model predicts more GRBs 
by a factor of ~ 3 at this r edshift, in better a gree- 
ment with the observe d rate. iDaigne et al.1 (J2006I ) and 
iGuetta fc Piranl (|2007f ) have similarly found that an en- 
hancement of high-redshift GRBs is needed with respect 
to several existing estimates of the SFR. Although it 

10 This gas need not have the same temperature as the diffuse 
IGM, but atomic cooling will prevent it from reaching much higher 
values in dense systems. 

11 The absolute normalization of this rate is poorly constrained 
at present owing to the complicated selection function of the bursts. 
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Fig. 13. — Predicted gamma-ray burst rate per unit redshift 
per steradian in arbitrary units, assuming that the GRB rate dcn- 
sity fo llows the star formation rate densi ty of Hcrnauist & SprinEcl 
J2003h (solid) and Hopkin s fc Beacoml 1 12009) (long dashed) as 
show n in Fig urc ll2l The dotted lines indicate the rates at z = 4, at 
which lKistler et al . (2008) find that the lHopkins fc Beacoml (f2006l ) 
SFR underestimates the observed GRB rate by a factor of four. 
The Hcrnauist & Sprinjjcl (2003) SFR model prediction is in bet- 
ter agreement with the observed GRB rate at this redshift. 

remains to be established whether the GRB rate actu- 
ally traces star formation linearly, this provides further 
circumstantial evidence that the S FR does not decline 
strong ly beyond z ~ 3 as in the Hop kins fc Beacoml 
(2006) fit. Along with the supporting arguments based 
on the IGM opacity that we have developed in this paper, 
this also indicates that it may be premature to draw con- 
clusions about deviations of GRBs from star formation 
based on the present observational estimates. 

7.3. A Large Population of Very Faint Galaxies at High 

Redshifts ? 



We found in £15. 5. 1 | that a star format i on his tory peak- 
ing early as in the lHernquist fc Springe! (|2003[ ) model ap- 
pears to be necessary to reionize the Universe by z — 6. 12 
Such a star formation history also accommodates the ob- 
served z«4 GRB rate better ( §7.2j) . in addition to pro- 
viding an excellent fit to the intergalactic hydrogen pho- 
toionization rate now precisely measured at z = 2 — 4.2 
( §5.3p . Yet, it appears to overestimate the SFR esti- 
mated from directly int egrating the observed UV lumi- 
nosity function at z > 5 (jBouwens et al.ll2007l 36. 3[) . Can 
these results be reconciled? 

An intriguing possibility is that the very high red- 
shift Universe harbors a large number of extremely faint 
galaxies that are missed by even the deepest survey s 
to date (jYoshida et alJl2006t iBouwens et al.ll2007ll2008h . 
As we have integrated the measured luminosity functions 

12 Note that by normalizing to the ionizing emissivity implied 
by the Lya forest at z = 3, our calculation implicitly assu mes the 
small escape fraction / ~ 0.5% also implied by the forest f i|5.6l l. 



down to zero luminosity, this would require a significant 
steepening of the faint-end slope of the UV luminosity 
function below the present observational limits. Faint 
galaxies may in fact already have been det ected in abun- 
dance in t he deep z ~ 6 — 10 searches of Richar d et al.l 
HHI) and lStarket~aT1 (|2007ti ). although the authentic- 
ity of the candidates remain challenging to confirm and 
their lar ge number poses c hallenges to theoretical expec- 
tations ([Stark et al.ll2007d\ The recent det ection of very 
faint L yman emitters at 2.67 < z < 3.75 bv lRauch et al.l 
( 2007) that would have been missed in existing LBG sur- 
veys also reminds us that the very dim Universe may 
contain surprises. 

Ultimately, the viability of this possibility will be ad- 
dressed by future, deeper surveys with instruments such 
as the James Webb Space Telescope 13 , the Thirty Meter 
Telescope 14 , and the Giant Magellan Telescope. 15 



7.4. The Sources of Reionization 

The decline of the quasar luminosity function and the 
increasing dominance of stellar emission to the high- 
rcdshift z > 3 ionizing background make a compelling 
case that the Universe was reionized by stars. This 
gives credibility to analytical and numerical calcula- 
tions of h ydrogen reionization that make this assump- 
tion (e.g., Sokasian et al. 2003b; Furlan etto et all 12004 
iMcQuinnet all l2007rJ : IZahn et all 12007ft . This is en- 
couraging news for upcoming observational probes of the 
epoch of reionization, such as redshift ed 21-cm emission 
and high-redshift Lya emitters (e.g.. IZaldarriaea et al.l 
12004 iMcQuinn et al.ll2007aHMao et al.ll2008l) . whose de- 
tailed interpretation will rely on our understanding of the 
morphology of a reionization and its origin. 
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Fig. 14. — Hydrogen photoionization rate in the 

Haardt & Madau (1996) model (long dashed) compared to our em- 
pirical measurement from the Lya forest (squares). 



7.5. Models of the Ionizing Background 

Hydrodynami cal cosmological simula ti ons (e.g., 

Hernauist et all 119961: iKatz et all Il996al iDave et all 



1999; Springcl & Hernauist 2003b) require a model of 
the ionizing background in order to calculate the thermal 
evolution of the gas. Most simulations presently adopt a 
model based on the pioneering work of lHaardt fc Madaul 
(1996) or one of its variants . In Figure [T4l we compare 
the lHaardt fc Madaul (|1996l ) model with our empirical 
measurement from the Lya forest. The model clearly 
deviates from our empirical measurement, highlighting 
the need for a new model of the UV background 
and its spectrum. Although both are u ncertain in 
normalization, the lHaardt fc Madaul (|1996h UV back- 
ground is dominated by quasars, peaks at z — 2 — 3, 
and subsequently declines steeply, in conflict with the 
measured intergalactic opacity, as we have argued at 
length. In instances where only the photoionization rate 
r is of interest, our empirical measurement will provide 
a valuable input to simulations. 

7.6. Comparison with Previous Work 

In many ways where there is overlap, our results echo 
and strengthen conclusions previously reac hed in a num- 
ber o f studies of the UV bac kgroun d (e.g . , iRauch et al] 
19971: iMcDonald fe Miralda-Escu dc 2001: Bolto n et all 



2005 ) . iBolton et al.l (|2005f ) , in p articular, inferred T from 



the Lya opacity measurement of lSchave et al.l (|2003l ) and 
also found its evolution to be consistent with being con- 
stant at 2 < z < 4. They found values of the photoion- 
ization rate r ~ 1 x 10" 12 s _1 systematically higher than 
ours but with large error bars not inconsistent with them. 
These authors performed a more detailed analysis of the 
sources of error in their measurement, including param- 
eters of the cosmology and thermal state of the IGM, 
than we did here. As the full thermal history of IGM 
is possibly as important (see remarks in ij3.2p and re- 
mains an open and difficult question in itself, we have 
here inferred the photoionization rate in a relatively sim- 
plistic manner, focusing our efforts instead on the impli- 
cations for its sources. More work remains to be done 
to refine the absolute normalization of the ionizing back- 
ground. By comparing with the estimated quasar con- 
tribution, IBolton et al.l (|2004f ) also found evidence for a 
stellar-dominated UV background at all redshifts. Their 
argument was mostly based on the absolute value of T. 
As its redshift evolution is constrained in much finer de- 
tail here, we have made use of its flat shape in conjunction 
with the narrow peak of the quasar luminosity function 
to provide an argument that is more robust to normal- 
ization uncertainties. 

Meas urements bas ed on the proxim ity ef- 
fe ct (Earswell et al.l H987J [ Baitlik et all 119881: 



LuetalJ 1 19911 iKulkarni fc Fall! 119931: iWilliger et all 
19941: ICristiani et all 119951: iGiallongo et al.l 119961: 



high (|Loeb fc Eisensteinl 119951 : iFaucher-Giguere et al.1 
l2008bf l. Moreover, many previous studies of the 
proximity effect used quasar systemic redshifts based 
on broad emission lines, which are increasingly rec- 
ognized as biased measu res as a res u lt of inflows 
and o utflows of material (iGaskelll 119821: iTvtler fc Fad 
1992t IVanden Berk et ail 120011: iRichards et al.l 120021 : 



Hennawi et all 120061: iHennawi fc Prochaskal 120071 ). In 
contrast, the flux decrement method is both easier to 
model theoretically and prone to fewer observational 
challenges. Moreover, it provides much better statistics, 
as the Lya forest typically covers a region away from 
the quasar much longer than its proximity region. 
We therefore regard it as the more robust method of 
measuring T from the forest. 

A number of previous studies of the LBG UV lu- 
minosity function have also found little evidence for 
a decline of the SFR density beyond z ~ 3 (e.g., 
Steidel et afll!999l: [Giayalisco et alj ' l2004b lYoshida et all 
20061 : iReddv et al.ll2008h . This finding has in addition 



Srianand fc Khard 119961 : IScott et al.ll2000f ) have tended 
to yield T values higher by a factor of ~ 3 (c.f. 
Figure [l}. However, the overdense regions in which 
quasars reside are likely to bias these measurements 



been corrobor ated by measures based on photometri c 
redshifts (e.g.. iThompson et alJl200H lThompsonll2003h . 
Recently, ISiana et al.l (|2008t ) have also come to the con- 
clusion that quasars can contribute at most about half 
of the total photoionization rate at z ~ 3 from an opti- 
cal/infrared selection of quasars in the Spitzer Wide-area 
Infrared Extragalactic (SWIRE) Legacy Survey, though 
their argument relies on the uncertain conversion from a 
luminosity function to an ionization rate (see §5.3p . 

If only because the SFR density is expected to rise con- 
tinuously on physical g rounds, it must event ually decline 
toward high redshifts. iBouwens et al.l (|2007| ) in fact find 
evidence for such a decline toward z = 6 on the basis of 
evolving dust obscura tion suggested by obse rved /3- values 
at this redshift (e.g., IStanwav et al.ll2005t ). We simply 
contend here that neither the present Lya forest data 
nor the recent UV luminosity functions compiled here, 
especially when considered together with their mutual 
scatter, show convincing evidence for the often-assumed 
peak in SFR density near z ~ 2 — 3. 

8. CONCLUSIONS 

We have investigated the implications of the evolution 
of the intergalactic opacity for the sources responsible 
for its photoionization. The principal constraint is our 
measurement of the Lya effective optical depth over the 
redshift range 2 < z < 4.2 from a samp le of 86 high- 
resolution quasar spectra (jFaucher-Giguere et" al. 2008c). 
We also imposed the requirements that intergalactic HI 
must be reionized by z — 6 and Hell by z « 3, and 
used estimates of the hardness of the ionizing background 
from HI to Hell column density ratio measurements. Our 
main conclusions are as follows: 

1. The intergalactic hydrogen photoionization rate is 
remarkably constant over the redshift range 2 < 
z < 4.2, with a value T w (0.5 ± 0.1) x 10~ 12 
s _1 , subject to remaining systematic uncertainties 
in normalization. 

2. Because the quasar luminosity function is strongly 
peaked near z ~ 2, the lack of redshift evolution 
implies that star-forming galaxies are likely to dom- 
inate the photoionizing background at z > 3, and 
possibly at all redshifts probed. 
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3. Although our arguments are robust to normaliza- 
tion systematics, fiducial assumptions regarding 
the mean free path of ionizing photons, the spectral 
energy distribution of quasars, and an escape frac- 
tion of ionizing photons from quasars of unity imply 
that quasars alone overproduce the total ionizing 
background near their peak. This puzzle suggests 
that these assumptions warrant more scrutiny and 
highlights the uncertainties in calculating the ion- 
izing background by integrating luminosity func- 
tions. 

4. Only a small escape fraction of ionizing photons 
/osc ~ 0.5% is needed for galaxies to solely ac- 
count for the entire UV luminosity density implied 
by the Lya forest, with the scaling with uncertain 
parameters given in equation 1451 This small frac- 
tion might be reconciled with higher measurements 
from the direct detection of Lym an-continuum 
photons from high-redshift galaxies (|Steidel et al.l 
120011 : IShaplev et all I2006T ) if it increases with 
galaxy luminosity. 

5. The state-of-the-art observati onal fit to the cos- 
mic st ar formation history by iHopkins fc Beacoml 
(2006) (peaking near z ~ 2 similarly to quasar 
activity) appears to underestimate the total pho- 
toionization rate by almost an order of magnitude 
at z w 4 if the escape fraction and dust obscuration 
are constant with redshift for z > 2, and is also in 
tension with the most recent high-redshift determi- 
nations of the galaxy UV luminosity function. 

6. Normalizing the ionizing emissivity predicted 
by the best-fit s tar f ormation history of 
Hopk ins fc Beacoml (J2006) to our Lya forest 
measurement at z = 3, their star formation history 
fails to reionize the Universe by z = 6. 

7. A star formation history peaking at a higher red- 
shift z = 5 — 6, like the theoretical model of 
iHernquist fc Springell (|2003f ). fits the 2 < z < 4.2 
Lya forest well, reionizes the Universe in time, and 
is in better agreement with the rate of GRBs ob- 
served by Swift at z sw 4. 

8. Quasars alone suffice to doubly ionize helium by 
z«3 provided that most of the Hell ionizing pho- 
tons they produce escape into the IGM. 

9. The ratio the HI to the Hell column densities in 
the post-Hell reionization epoch 2 < z < 3 sug- 
gests, with a significant uncertainty arising from 
the large fluctuations observed, that quasars con- 
tribute a non-negligible fraction (> 20%) and per- 
haps dominate the hydrogen ionizing background 
at their z ~ 2 peak. 



Although the present uncertainties in the redshift evo- 
lution of UV dust corrections, the escape fraction of ion- 
izing photons from galaxies, and possible evolution of 
the stellar initial mass function however prohibit defini- 
tive conclusions about the cosmic SFR to be reached at 
this time, we have illustrated how the IGM represents 
a powerful integral probe of the cosmic luminosity den- 
sity free of the completeness issues that affect the direct 
detection of its sources. In this sense, its study is very 
complementary to that of luminosity functions. 

In this work, we have strived to make the simplest 
assumptions consistent with our present body of knowl- 
edge. For instance, we have assumed that the escape 
fraction of ionizing photons from star-forming galaxies 
is constant with redshift and found evidence that the 
high-redshift (z > 3) SFR density is currently underesti- 
mated by direct galaxy counts. Of course, many of our 
arguments could be logically reversed and, for example, 
instead favor an evolving escape fraction on the basis of 
the present estimates of the star formation history. More 
work is certainly needed in order to break such degenera- 
cies, but a robust conclusion is that the simplest picture 
contains inconsistencies, the resolution of which is poised 
to teach us about early star formation, AGN activity, and 
perhaps more. 

Better constraints on the thermal history of the IGM 
and on the abundance of the Lyman-limit systems which 
determine the mean free path of ionizing photons will be 
key in reducing the systematic uncertainties in the argu- 
ments presented here. In addition, improved determina- 
tions of the spectral indices of quasars and star-forming 
galaxies, especially shortward of the Lyman limit, will 
be useful in refining our calculations. In the same vein, 
an updated calculation of the full spectrum of the ion - 
izing background, like that of lHaardt fc Madaul (1996), 
is clearly warranted in the light of our improved empir- 
ical knowledge of the physical state of the IGM and of 
the luminosity functions of both quasars and galaxies 
(Faucher-Giguere et al., in prep.). 
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